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ABSTRACT 

This is the third in a series of short books on probability theory and random processes for 
biomedical engineers. This book focuses on standard probability distributions commonly en- 
countered in biomedical engineering. The exponential, Poisson and Gaussian distributions are 
introduced, as well as important approximations to the Bernoulli PMF and Gaussian CDF. 
Many important properties of jointly Gaussian random variables are presented. The primary 
subjects of the final chapter are methods for determining the probability distribution of a func- 
tion of a random variable. We first evaluate the probability distribution of a function of one 
random variable using the CDF and then the PDF. Next, the probability distribution for a 
single random variable is determined from a function of two random variables using the CDF. 
Then, the joint probability distribution is found from a function of two random variables using 
the joint PDF and the CDF. 

The aim of all three books is as an introduction to probability theory. The audience 
includes students, engineers and researchers presenting applications of this theory to a wide 
variety of problems — as well as pursuing these topics at a more advanced level. The theory 
material is presented in a logical manner — developing special mathematical skills as needed. 
The mathematical background required of the reader is basic knowledge of differential calculus. 
Pertinent biomedical engineering examples are throughout the text. Drill problems, straight- 
forward exercises designed to reinforce concepts and develop problem solution skills, follow 
most sections. 
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This is the third in a series of short books on probability theory and random processes for 
biomedical engineers. This text is written as an introduction to probability theory The goal 
was to prepare students at the sophomore, junior or senior level for the application of this 
theory to a wide variety of problems - as well as pursue these topics at a more advanced 
level. Our approach is to present a unified treatment of the subject. There are only a few key 
concepts involved in the basic theory of probability theory. These key concepts are all presented 
in the first chapter. The second chapter introduces the topic of random variables. The third 
chapter focuses on expectation, standard deviation, moments, and the characteristic function. 
In addition, conditional expectation, conditional moments and the conditional characteristic 
function are also discussed. The fourth chapter introduces jointly distributed random variables, 
along with joint expectation, joint moments, and the joint characteristic function. Convolution 
is also developed. Later chapters simply expand upon these key ideas and extend the range of 
application. 

This short book focuses on standard probability distributions commonly encountered in 
biomedical engineering. Here in Chapter 5, the exponential, Poisson and Gaussian distributions 
are introduced, as well as important approximations to the Bernoulli PMF and Gaussian CDF. 
Many important properties of jointly distributed Gaussian random variables are presented. 
The primary subjects of Chapter 6 are methods for determining the probability distribution of 
a function of a random variable. We first evaluate the probability distribution of a function of 
one random variable using the CDF and then the PDF. Next, the probability distribution for a 
single random variable is determined from a function of two random variables using the CDF. 
Then, the joint probability distribution is found from a function of two random variables using 
the joint PDF and the CDF. 

A considerable effort has been made to develop the theory in a logical manner - developing 
special mathematical skills as needed. The mathematical background required of the reader is 
basic knowledge of differential calculus. Every effort has been made to be consistent with 
commonly used notation and terminology — both within the engineering community as well as 
the probability and statistics literature. 

The applications and examples given reflect the authors' background in teaching prob- 
ability theory and random processes for many years. We have found it best to introduce this 
material using simple examples such as dice and cards, rather than more complex biological 
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viii PREFACE 

and biomedical phenomena. However, we do introduce some pertinent biomedical engineering 
examples throughout the text. 

Students in other fields should also find the approach useful. Drill problems, straightfor- 
ward exercises designed to reinforce concepts and develop problem solution skills, follow most 
sections. The answers to the drill problems follow the problem statement in random order. 
At the end of each chapter is a wide selection of problems, ranging from simple to difficult, 
presented in the same general order as covered in the textbook. 

We acknowledge and thank William Pruehsner for the technical illustrations. Many of the 
examples and end of chapter problems are based on examples from the textbook by Drake [9]. 
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CHAPTER 5 




A surprisingly small number of probability distributions describe many natural probabilistic 
phenomena. This chapter presents some of these discrete and continuous probability distribu- 
tions that occur often enough in a variety of problems to deserve special mention. We will see 
that many random variables and their corresponding experiments have similar properties and 
can be described by the same probability distribution. Each section introduces a new PMF or 
PDF. Following this, the mean, variance, and characteristic function are found. Additionally, 
special properties are pointed out along with relationships among other probability distribu- 
tions. In some instances, the PMF or PDF is derived according to the characteristics of the 
experiment. Because of the vast number of probability distributions, we cannot possibly discuss 
them all here in this chapter. 

5.1 UNIFORM DISTRIBUTIONS 

Definition 5.1.1. The discrete RV x has a uniform, distribution over n points [n > 1) on the 
interval [a, b\ ifx is a lattice RV with span h = [b — a)/(n — 1) and PMF 




(5.1) 
otherwise. 

The mean and variance of a discrete uniform RV are easily computed with the aid of 
Lemma 2.3.1: 

n—\ 



lri x h y K [2] 1 b - a n(n - 1) b + a 

k=0 



(kh + a) = --— +a = \-a = — — , (5.2) 

,,, , . n 2 n n — 1 2 



and 



1^1/ b-a\ 2 {b-af n ^\( k 2 k 1\ 



Simplifying, 



(b - af n + 1 



< = —^T v (5A) 

12 n — 1 
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2 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 



,,Pj a ) 
.05 -> ~ffffffffffffffffff i 



k\*M 



M«l |l • »■ 




(a) 

FIGURE 5.1: (a) PMF and (b) characteristic function magnitude for discrete RV with uniform distri- 
bution over 20 points on [0, 1]. 



The characteristic function can be found using the sum of a geometric series: 



72-1 



w = — Yyv 



k=0 



git 1 - e jhnt 

n 1 - e-' ht 



(5.5) 



Simplifying with the aid of Euler's identity, 



4> x {t) = exp h- 



2 ; „ sin (^ _!_,)• 



(5.6) 



Figure 5.1 illustrates the PMF and the magnitude of the characteristic function for a discrete RV 
which is uniformly distributed over 20 points on [0, 1]. The characteristic function is plotted 
over [0, iilh\ where the span h = 1/19. Recall from Section 3.3 that (j) x (—t) = <j>*{t) and that 
<p x (t) is periodic in t with period 2ix/h. Thus, Figure 5.1 illustrates one-half period of \4> x {-)\. 

Definition 5.1.2. The continuous RV x has a uniform distribution on the interval [a , b\ ifx has 
PDF 



Ma) 



l/{b-a), 
0, 



a < a < b 
otherwise. 



(5.7) 



The mean and variance of a continuous uniform RV are easily computed directly: 



>h 





-f 

— a J 



a da 



b + a 



2(b - a) 



(5.8) 
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.5 1 

(a) 

FIGURE 5.2: (a) PDF and (b) characteristic function magnitude for continuous RV with uniform 
distribution on [0, 1]. 



and 



hf(° 



+■ a\" (b — a) 2 

da = 



The characteristic function can be found as 



da 



<t>M = T^— f J" 

b — a J 

a 

Simplifying with the aid of Euler's identity, 



b — a 



12 



(b-a)/2 



(5.9) 



f 



e' at da. 



-(*-«)/2 



a + b ^ sin (^) 

<Px\t) = exp [j — — t 



(5.10) 



Figure 5.2 illustrates the PDF and the magnitude of the characteristic function for a continuous 
RV uniformly distributed on [0,1]. Note that the characteristic function in this case is not 
periodic but (j) x (—t) = 4>* x {t). 

Drill Problem 5.1.1. A pentahedral die (with faces labeled 0,1,2,3,4) is tossed once. Let x be a 
random variable equaling ten times the number tossed. Determine: (a) p x (20), (b) P(10 < x < 50), 
(c) E(x), (d) a 2 x . 

Answers: 20, 0.8, 200, 0.2. 

Drill Problem 5.1.2. Random variable x is uniformly distributed on the interval [— 1, 5]. Deter- 
mine: (a) F x (0), (b) F x {5), (c) rj x , (d) a 2 . 

Answers: 1, 1/6, 3, 2. 
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4 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

5.2 EXPONENTIAL DISTRIBUTIONS 

Definition 5.2.1. The discrete RV x has a geometric distribution or discrete exponential distri- 
bution with parameter p(0 < p < 1) ifx has PMF 



px{ot) 



p(l-pT-\ a = 1,2,... 



(5.11) 



0, otherwise. 

The characteristic function can be found using the sum of a geometric series {q = 1 — p): 

(5.12) 



*„(/) = J£(y«T = r 



,j* 






The mean and variance of a discrete RV with a geometric distribution can be computed using 
the moment generating property of the characteristic function. The results are 

1 



an 



d a 



2 1 



p p2 



(5.13) 



Figure 5.3 illustrates the PMF and the characteristic function magnitude for a discrete RVwith 
geometric distribution and parameter p = 0.18127. 

It can be shown that a discrete exponentially distributed RV has a memoryless property: 



p x \ x> i(a\x > I) = p x (a - £), l>0. 



(5.14) 



Definition 5.2.2. The continuous RV x has an exponential distribution with parameter \{\ > 0) 
ifx has PDF 



f x (a) = Xe~ ka u{a), 



(5.15) 



where u(-) is the unit step function. 



iP*(a) 



.09 



mT|Tf .f.... . 



10 
(a) 



20 a 




(b) 



FIGURE 5.3: (a) PMF and (b) characteristic function magnitude for discrete RV with geometric dis- 
tribution [p = 0.18127]. 
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FIGURE 5.4: (a) PDF and (b) characteristic function magnitude for continuous RV with exponential 
distribution and parameter X = 0.2. 

The exponential probability distribution is also a very important probability density function 
in biomedical engineering applications, arising in situations involving reliability theory and 
queuing problems. Reliability theory, which describes the time to failure for a system or compo- 
nent, grew primarily out of military applications and experiences with multicomponent systems. 
Queuing theory describes the waiting times between events. 
The characteristic function can be found as 



b x {t) = X 






X 



X-jt 



(5.16) 



Figure 5.4 illustrates the PDF and the magnitude of the characteristic function for a continuous 
RV with exponential distribution and parameter X = 0.2. 

The mean and variance of a continuous exponentially distributed RV can be obtained 
using the moment generating property of the characteristic function. The results are 



>?A 



1 

X' 



a ~ 



1 



(5.17) 



A continuous exponentially distributed RV, like its discrete counterpart, satisfies a memoryless 
property: 



/»|<>r(«k>t) = /,(a-t), T > 0. 



(5.18) 



Example 5.2.1. Suppose a system contains a component that has an exponential failure rate. Reli- 
ability engineers determined its reliability at 5000 hours to be 95%. Determine the number of hours 
reliable at 99%. 
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6 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 
Solution. First, the parameter A. is determined from 



/ 



-*■<*!„, _ -5000/ 



0.95 = P(x > 5000) = / Xe~ ka da = e~ 

5000 

Thus 

- ln(0.95) , 

A = = 1.03 x 10 -5 . 

5000 

Then, to determine the number of hours reliable at 99%, we solve for a from 

P(x >a) = e~ ka = 0.99 

or 

-ln(0-99) 
a = = 980 hours. g 

Drill Problem 5.2.1. Suppose a system has an exponential failure rate in years to failure with 
A, = 0.02. Determine the number of years reliable at: (a) 90%, (b) 95%, (c) 99%. 

Answers: 0.5, 2.6, 5.3. 

Drill Problem 5.2.2. Random variable x, representing the length of time in hours to complete an 
examination in Introduction to Random Processes, has PDF 

4 1 
/*(«) = -e~3 a u(a). 



The examination results are given by 



75, < x < 4/3 

75 + 39.44(* - 4/3), x > 4/3 

0, otherwise. 



Determine the average examination grade. 
Answer: 80. 

5.3 BERNOULLI TRIALS 

A Bernoulli experiment consists of a number of repeated (independent) trials with only two 
possible events for each trial. The events for each trial can be thought of as any two events which 
partition the sample space, such as a head and a tail in a coin toss, a zero or one in a computer 



PI: IML/FFX 
MOBK042-05 



P2: IML 

MOBK042-Enderle.cls 



October 30, 2006 19:51 



STANDARD PROBABILITY DISTRIBUTIONS 7 

bit, or an even and odd number in a die toss. Let us call one of the events a success, the other 
a failure. The Bernoulli PMF describes the probability of k successes in n trials of a Bernoulli 
experiment. The first two chapters used this PMF repeatedly in problems dealing with games 
of chance and in situations where there were only two possible outcomes in any given trial. 
For biomedical engineers, the Bernoulli distribution is used in infectious disease problems and 
other applications. The Bernoulli distribution is also known as a Binomial distribution. 

Definition 5.3.1. A discrete RV x is Bernoulli distributed if the PMF for x is 



pM 



p k q n ~\ 



0. 



k = 0, 1, . . . , n 
otherwise, 



(5.19) 



where p = probability of success and q = 1 — p. 

The characteristic function can be found using the binomial theorem: 






(5.20) 



Figure 5.5 illustrates the PMF and the characteristic function magnitude for a discrete RV with 
Bernoulli distribution, p = 0.2, and n = 30. 

Using the moment generating property of characteristic functions, the mean and variance 
of a Bernoulli RV can be shown to be 



r\ x = np, 



o\, = ni 



(5.21) 



, 


A (a) 






.18- 


- 

• 


1 






• 


< ' 








• 




.09- 


• 


• 






ll 








10 20 a 1 2 

(a) (b) 

FIGURE 5.5: (a) PMF and (b) characteristic function magnitude for discrete RV with Bernoulli distri- 
bution, p — 0.2 and n = 30. 



PI: IML/FFX P2: IML 

MOBK042-05 MOBK042-Enderle.cls October 30, 2006 19:51 



8 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

Unlike the preceding distributions, a closed form expression for the Bernoulli CDF is not 
easily obtained. Tables A.l— A. 3 in the Appendix list values of the Bernoulli CDF for p = 
0.05, 0.1, 0.15, . . . , 0.5 and n = 5, 10, 15, and 20. Let k e {0, 1, ...,»- 1} and define 

G(n,k,p) = £(AAl-pr*. 

Making the change of variable m = n — I yields 

G(n,k,p)= J2 ( n )f- m a-?y 

1 * \ ■n — **7 I 

Now, since 



, n — m 

-n—k \ , 






n — m I ml [n — m)\ \ m 



n-k-l 



G (n,k,p) = j:( n )f-(i-pr- j: Hrd-/r. 



. m I ", \ m 



Using the Binomial Theorem, 

G(n, k,p) = l- G(n, n - k - 1, 1 - p). (5.22) 

This result is easily applied to obtain values of the Bernoulli CDF for values of p > 0.5 from 
Tables A.1-A.3. 

Example 5.3.1. The probability that Fargo Polytechnic Institute wins a game is 0. 7. In a 15 game 
season, what is the probability that they win: (a) at least 10 games, (b)from 9 to 12 games, (c) exactly 
11 games? (d) With x denoting the number of games won, find r] x and a^. 

Solution. With x a Bernoulli random variable, we consult Table A.l, using (5.22) with n = 15, 
k = 9, and p = 0.7, we find 

a) P(x > 10) = 1 - F x (9) = 1.0 - 0.2784 = 0.7216, 

b) P(9 < x < 12) = F x (12) - F,(8) = 0.8732 - 0.1311 = 0.7421, 

c) p x (ll) = F x (ll) - F x (10) = 0.7031 - 0.4845 = 0.2186. 

d) r] x = np = 10.5, aj = np(l - p) = 3.15. ■ 
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STANDARD PROBABILITY DISTRIBUTIONS 9 

We now consider the number of trials needed for k successes in a sequence of Bernoulli trials. 
Let 



p{k, n) = P{k successes in n trials) 



(5.23) 



p k q"~ k , k = 0, !,...,« 



0, 



otherwise, 



where p = p(l, 1) and q = 1 — p. Let RV n r represent the number of trials to obtain exactly 
r successes (r > 1). Note that 

P(success in £th trial \r — 1 successes in previous I — 1 trials) = p; (5-24) 

hence, for I = r, r + 1 , . . . , we have 

P(n r = €) = p(r - 1, 1 - \)p. (5.25) 

Discrete RV n r thus has PMF 

1 1-\ 



Pn,{l) 



r -\ 



fr 



0. 



I = r, r + 1, 
otherwise, 



(5.26) 



where the parameter r is a positive integer. The PMF for the RV n r is called the negative 
binomial distribution, also known as the Polya and the Pascal distribution. Note that with 
r = 1 the negative binomial PMF is the geometric PMF. 

The moment generating function for n r can be expressed as 



(r - 1)! 



Letting m = I — r, we obtain 



With 



M Br (A) = ^— V (m + r - \){m + r -2) • • ■ (m + l)(qe x ) m . 

(r ~ 1)! _ n 



oo -, 
^(^) = N x = , |#| < 1, 

t!> 1 ~ x 
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10 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

we have 



jt-i 



s®(x) = J2 k(k - 1) ■ ■ • (k - I + l)x k 

k=t 

00 

= j^(» + l){m + I - 1) • • • (m + 1)*" 



m=0 



(1-*) 



m* 



Hence 



M„,.(A) 



/»< 



1 — »^ 



ye* < 1. 



The mean and variance for n r are found to be 



r A 2 r 9 

r]„ r = -, and a = -z. 

P P 



We note that the characteristic function is simply 



KM = M nr (jt) = ct> r x {t), 



(5.27) 



(5.28) 



(5.29) 



where RV x has a discrete geometric distribution. Figure 5.6 illustrates the PMF and the 
characteristic function magnitude for a discrete RV with negative binomial distribution, r = 3, 
and/ =0.18127. 



iP.(°0 




\W l A 



JITTTTTTtt^. — , 



40 a 




P=— 1 1 1 h 



(a) 



1 2 

(b) 



FIGURE 5.6: (a) PMF and (b) magnitude characteristic function for discrete RV with negative binomial 
distribution, r — 3, and p — 0.18127. 
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STANDARD PROBABILITY DISTRIBUTIONS 11 

5.3.1 Poisson Approximation to Bernoulli 

When n becomes large in the Bernoulli PMF in such a way that np = X = constant, the 
Bernoulli PMF approaches another important PMF known as the Poisson PMF. The Poisson 
PMF is treated in the following section. 



Lemma 5.3.1. We have 



p{k) = lim fq 

1 n^oo,np=X \ k ' 



k „n—k 



k„-l. 



X k e 



k = 0,1, 



k\ (5.30) 

0, otherwise, 



Proof. Substituting p = - and q = 1 



Note that 



>«-2&s(i)'Hrn<-o 

/ X\~ kk ~ l 
lim n~ k [ 1 - - 1(« - = 1, 



so 



that 



Now, 



/.(i) = lim — 1 - - 



lim In I 1 = lim : — — 



n— >oc \ fi 



so that 



e 

n—toc \ fi 



lim | 1 " ' 



from which the desired result follows. ■ 

We note that the limiting value p{k) may be used as an approximation for the Bernoulli 
PMF when p is small by substituting X = np. While there are no prescribed rules regarding the 
values of n and p for this approximation, the larger the value of n and the smaller the value of p, 
the better the approximation. Satisfactory results are obtained with np < 10. The motivation 
for using this approximation is that when n is large, Tables A.l— A.3 are useless for finding 
values for the Bernoulli CDF. 
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12 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

Example 5.3.2. Suppose x is a Bernoulli random variable with n = 5000 and p = 0.001. Find 
P(x < 5). 

Solution. Our solution involves approximating the Bernoulli PMF with the Poisson PMF 
since n is quite large (and the Bernoulli CDF table is useless), and p is very close to zero. 
Since A = np = 5, we find from Table A. 5 (the Poisson CDF table is covered in Section 4) that 
P(x < 5) = 0.6160. ■ 

Incidentally, if p is close to one, we can still use this approximation by reversing our definition of 
success and failure in the Bernoulli experiment, which results in a value of p close to zero — see 
(5.22). 

5.3.2 Gaussian Approximation to Bernoulli 

Previously, the Poisson PMF was used to approximate a Bernoulli PMF under certain conditions, 
that is, when n is large, p is small and np < 10. This approximation is quite useful since the 
Bernoulli table lists only CDF values for n up to 20. The Gaussian PDF (see Section 5.5) 
is also used to approximate a Bernoulli PMF under certain conditions. The accuracy of this 
approximation is best when n is large, p is close to 1/2, and npq > 3. Notice that in some 
circumstances np < 10 and npq > 3. Then either the Poisson or the Gaussian approximation 
will yield good results. 



Lemma 5.3.2. Let 



x — np 

y = -f=> < 5 - 31 ) 

sl n pq 



where x is a Bernoulli RV. Then the characteristic function for y satisfies 
Proof. We have 



4>(t) = lim (p y (t) = e~ f /2 . (5.32) 



np 
,(t) = exp -j- 



Substituting for (j) x {t). 



s/npq ) ' X-s/npq 
,0?) = exp l-jl — tj lq+p exp Ij 



Simplifying, 



0J-OO = ( q exp ( -jtj — J + p exp [jt 
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STANDARD PROBABILITY DISTRIBUTIONS 13 



Letting 



we obtain 



P = /-, and a = J-, 
V p V « 



1 ,n, 1 n f , M=lim '" ( ^'"" , : + ^ , * ) . 

h-s-cx) ^ a^O a 2 

Applying L'Hospital's Rule twice, 

-jtpPe-MP+jtpPeW' -t 2 p - t 2 ^p t 2 
lim ln<p,,m = lim = = . 

Consequently, 

lim (f)y(t) = exp I lim ln</> v (/)) = e~ ' . 

■ 

The limiting (/>(/) in the above lemma is the characteristic function for a Gaussian RV 
with zero mean and unit variance. Hence, for large n and a < b 

P{a < x < b) = P{a' <y < £') ~ ^') - /V), (5.33) 

where 

r 

F(y) = -±- / ^"" 2/2 ^ = 1 " Q(y) ( 5 - 34 ) 

\I2tz J 



(5.35) 



is the standard Gaussian CDF, 

, a — np , b — np 

a = . b = 

jnpq s/npq 

and Q() is Marcum's Q_function which is tabulated in Tables A.8 and A. 9 of the Appendix. 
Evaluation of the above integral as well as the Gaussian PDF are treated in Section 5.5. 

Example 5.3.3. Suppose x is a Bernoulli random variable with n = 5000 and p = 0.4. Find 
P(x < 2048). 

Solution. The solution involves approximating the Bernoulli CDF with the Gaussian CDF 
since npq = 1200 > 3. With np = 2000, npq = 1200 and V = (2048 - 2000)/34.641 = 
1.39, we find from Table A.8 that 

P(x < 2048) % F(1.39) = 1 - Q(1.39) = 0.91774. ■ 
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14 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

When approximating the Bernoulli CDF with the Gaussian CDF, a continuous distribution is 
used to calculate probabilities for a discrete RV. It is important to note that while the approxi- 
mation is excellent in terms of the CDFs — the PDF of any discrete RV is never approximated 
with a continuous PDF. Operationally, to compute the probability that a Bernoulli RV takes an 
integer value using the Gaussian approximation we must round off to the nearest integer. 

Example 5.3.4. Suppose x is a Bernoulli random variable with n = 20 and p = 0.5. Find 
P(x = 8). 

Solution. Since npq = 5 > 3, the Gaussian approximation is used to evaluate the Bernoulli 
PMF, p x (S). With np = 10, npq = 5, a' = (7.5 - 10)/ V? = -1.12, and V = (8.5 - 10)/ 
v5 = —0.67, we have 

^,(8) = P(7.5 < x < 8.5) w F(-0.67) - F(-1.12) = 0.25143 - 0.13136; 

hence, p x (S) ~ 0.12007. From the Bernoulli table, p x (S) = 0.1201, which is very close to the 
above approximation. ■ 

Drill Problem 5.3.1. A survey of residents in Fargo, North Dakota revealed that 30% preferred a 
white automobile over all other colors. Determine the probability that: (a) exactly jive of the next 20 
cars purchased will be white, (b) at least five of the next twenty cars purchased will be white, (c) from 
two to five of the next twenty cars purchased will be white. 

Answers: 0.1789, 0.4088, 0.7625. 

Drill Problem 5.3.2. Prof. Rensselaer is an avid albeit inaccurate marksman. The probability she 
will hit the target is only 0.3. Determine: (a) the expected number of hits scored in 15 shots, (b) the 
standard deviation for 15 shots, (c) the number of times she must fire so that the probability of hitting 
the target at least once is greater than 1/2. 

Answers: 2, 4.5, 1.7748. 



5.4 POISSON DISTRIBUTION 

A Poisson PMF describes the number of successes occurring on a continuous line, typically a 
time interval, or within a given region. For example, a Poisson random variable might represent 
the number of telephone calls per hour, or the number of errors per page in this textbook. 

In the previous section, we found that the limit (as n — >• oo and constant mean np) of a 
Bernoulli PMF is a Poisson PMF. In this section, we derive the Poisson probability distribution 
from two fundamental assumptions about the phenomenon based on physical characteristics. 
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STANDARD PROBABILITY DISTRIBUTIONS 15 

The following development makes use of the order notation o(h) to denote any function 
g{h) which satisfies 

lim ^P = 0. (5.36) 

h^Q h 

For example, g{h) = ISh 2 + 7h 3 = o{h). 
We use the notation 

p(k, t) = P(k successes in interval [0, t]). (5.37) 

The Poisson probability distribution is characterized by the following two properties: 
(1) The number of successes occurring in a time interval or region is independent of the 
number of successes occurring in any other non-overlapping time interval or region. Thus, with 

A = {k successes in interval I\), (5.38) 



anc 



we nave 



B = {I successes in interval I2}, (5.39) 



P(A f)B) = P(A)P(B), if I 1 (M 2 = <D. (5.40) 

As we will see, the number of successes depends only on the length of the time interval 
and not the location of the interval on the time axis. 

(2) The probability of a single success during a very small time interval is proportional to 
the length of the interval. The longer the interval, the greater the probability of success. The 
probability of more than one success occurring during an interval vanishes as the length of the 
interval approaches zero. Hence 

p(l, 6) = U + 0(6), (5.41) 

and 

p(0,A) = l-M> +0(6). (5.42) 

This second property indicates that for a series of very small intervals, the Poisson process is 
composed of a series of Bernoulli trials, each with a probability of success p = kh + o{h). 
Since [0, x +h] = [0, r] U (t, t + h] and [0, r] n (t, t + h] = 4>, we have 

p(0, x + h) = p(0, v)p(0, h) = p(0, r)(l - U + o(h)). 
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16 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

Noting that 

p(0, x + h)- />(0, r) _ -khp(0, x) + o{h) 
1 ~ 1 

and taking the limit as h —> 0, 

d -l^l = -Xp(0,x), />(0,0) = 1, (5.43) 

ax 

This differential equation has solution 

p(0,x) = e- kr u(x). (5.44) 

Applying the above properties, it is readily seen that 

p(k, x + h) = p{k - 1, t)/(1, A) + /(*, x)p(Q, h) + o(h), 
or 

p{k,x + h) = p{k - 1, t)A.A + />(*, t)(1 - U) + 0(b), 

so that 

/(*, x + h)-p{k,x) o{h) 

l - l - V Xp(k, x) = Xp(k - 1, x) H — . 

h h 

Taking the limit as h —> 

,' + A/>(/S,t) = A/>(/S-1,t), £ = 1,2,..., ^5j 

AT 

with p{k, 0) = 0. It can be shown ([7, 8]) that 



p(k, x) = Xe~ kr / e Xt p{k - 1, f),// (5.46; 

o 
and hence that 

p(k,x)= K —j l u(x), k = 0,l,.... (5.47) 

The RV x = number of successes thus has a Poisson distribution with parameter Xr and PMF 
p x (k) = p(k, x). The rate of the Poisson process is A. and the interval length is X. 

For ease in subsequent development, we replace the parameter Xx with X. The characteris- 
tic function for a Poisson RV x with parameter X is found as (with parameter X, p x (k) = p(k, 1)) 

~ (Xe Jt ) k 
(j, x (t) = e~ x Y ~ r~ = e ~ X expW) = exp(k(e Jt - 1)). (5.48) 
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10 20 a 1 2 f 

(a) (b) 

FIGURE 5.7: (a) PMF and (b) magnitude characteristic function for Poisson distributed RV with 
parameter k — 10. 

Figure 5.7 illustrates the PMF and characteristic function magnitude for a discrete RV with 
Poisson distribution and parameter A = 10. 

It is of interest to note that if x\ and xj are independent Poisson RVs with parameters A.i 
and A.2, respectively, then 



4> X1+X2 {t) = exp((A! + k 2 ){e Jt - 1)); 



(5.49) 



i.e., x\ + X2 is also a Poisson with parameter Ai + A2. 

The moments of a Poisson RV are tedious to compute using techniques we have seen so 
far. Consider the function 



My) = e(y x ) 



(5.50) 



and note that 



^-1 



i,f{y) = E[y x - k Y\{x-i) 



;=0 



so that 



'k-i 



E\Jl(x-i))=fi k Kl). 
If x is Poisson distributed with parameter A, then 

f x (y) = ^ (y - 1} . 

so that 

f x k \y) = X k e«v-*; 



(5.51) 



(5.52) 
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18 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

hence, 



(k-l 



E Y\(x -i))= X k 



(5.53) 



In particular, E(x) = X, E(x(x — 1)) = X 2 = E(x 2 ) — X, so that a 2 = X 2 + A. — X 2 = X. 

While it is quite easy to calculate the value of the Poisson PMF for a particular number 
of successes, hand computation of the CDF is quite tedious. Therefore, the Poisson CDF is 
tabulated in Tables A.4-A.7 of the Appendix for selected values of A ranging from 0.1 to 18. 
From the Poisson CDF table, we note that the value of the Poisson PMF increases as the number 
of successes k increases from zero to the mean, and then decreases in value as k increases from 
the mean. Additionally, note that the table is written with a finite number of entries for each 
value of X because the PMF values are written with six decimal place accuracy, even though an 
infinite number of Poisson successes are theoretically possible. 



Example 5.4.1. On the average, Professor Rensselaer grades 10 problems per day. What is the 
probability that on a given day (a) 8 problems are graded, (b) 8-10 problems are graded, and (c) at 
least 15 problems are graded? 



Solution. With x a Poisson random variable, we consult the Poisson CDF table with X 
and find 



10, 



a) ^(8) = FM - F x (7) = 0.3328 - 0.2202 = 0.1126, 

b) P(8 < x < 10) = F x (10) - F x (7) = 0.5830 - 0.2202 

c) P(x > 15) = 1 - F x (14) = 1 - 0.9165 = 0.0835. 



0.3628, 



5.4.1 Interarrival Times 

In many instances, the length of time between successes, known as an interarrival time, of a 
Poisson random variable is more important than the actual number of successes. For example, 
in evaluating the reliability of a medical device, the time to failure is far more significant to the 
biomedical engineer than the fact that the device failed. Indeed, the subject of reliability theory 
is so important that entire textbooks are devoted to the topic. Here, however, we will briefly 
examine the subject of interarrival times from the basis of the Poisson PMF. 

Let RV t r denote the length of the time interval from zero to the rth success. Then 

p(t - h < tr < r) = p(r - 1, t - h)p(l, h) 

= p(r - 1, t - h)Xh +o(h) 
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STANDARD PROBABILITY DISTRIBUTIONS 19 

so that 

F tr {r) - F tr {r - h) o{h) 
= \p(r - 1, r - h) H — . 

Taking the limit as h — >• we find that the PDF for the rth order interarrival time, that is, the 
time interval from any starting point to the rth success after it, is 

Vr r ~ l e~ Xr 

AW = —, TT7-"( r )' r = 1, 2, . . . . ^.^ 

(r - 1)! 

This PDF is known as the Erlang PDF. Clearly, with r = 1, we have the exponential PDF: 

_/>(t) = \e~ u u(x). (5.55) 

The RV ^ is called the first-order interarrival time. 

The Erlang PDF is a special case of the gamma PDF: 

X r a r ~ 1 e~ ka 

fM) = — ^r\ — "(«)> ( 5 - 56 ) 

T(r) 

for any real r > 0, X > 0, where T is the gamma function 

oo 

T(r)= ! a r - l e- a da. (5.57) 

o 

Straightforward integration reveals that T(l) = 1 and T(r + 1) = rT{r) so that if r is a positive 
integer then T(r) = (r — 1)! — for this reason the gamma function is often called the factorial 
function. Using the above definition for T(r), it is easily shown that the moment generating 
function for a gamma-distributed RV is 



MM= (^37) - for r i <k - ( 5 - 58 ) 



The characteristic function is thus 



It follows that the mean and variance are 

T T 

r) x = -, and o 2 x = — . (5.60) 

A A z 

Figure 5.8 illustrates the PDF and magnitude of the characteristic function for a RV with 
gamma distribution with r = 3 and A = 0.2. 
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20 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 



A/, (a) 



aKwI 




(b) 

FIGURE 5.8: (a) PDF and (b) magnitude characteristic function for gamma distributed RV with r — 3 
and parameter X — 0.2. 



Drill Problem 5.4.1. On the average, Professor S. Rensselaer makes Jive blunders per lecture. 
Determine the probability that she makes (a) less than six blunders in the next lecture: (b) exactly Jive 
blunders in the next lecture: (c) from three to seven blunders in the next lecture: (d) zero blunders in 
the next lecture. 

Answers: 0.6160, 0.0067, 0.7419, 0.1755. 

Drill Problem 5.4.2. A process yields 0.001% defective items. If one million items are produced, 
determine the probability that the number of defective items exceeds twelve. 

Answer: 0.2084. 

Drill Problem 5.4.3. Professor S. Rensselaer designs her examinations so that the probability of at 
least one extremely difficult problem is 0.632. Determine the average number of extremely difficult 
problems on a Rensselaer examination. 

Answer: 1. 

5.5 UNIVARIATE GAUSSIAN DISTRIBUTION 

The Gaussian PDF is the most important probability distribution in the field of biomedical 
engineering. Plentiful applications arise in industry, research, and nature, ranging from instru- 
mentation errors to scores on examinations. The PDF is named in honor of Gauss (1777-1855), 
who derived the equation based on an error study involving repeated measurements of the same 
quantity. However, De Moivre is first credited with describing the PDF in 1733. Applications 
also abound in other areas outside of biomedical engineering since the distribution fits the 
observed data in many processes. Incidentally, statisticians refer to the Gaussian PDF as the 
normal PDF. 
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Definition 5.5.1. A continuous RV z is a standardized Gaussian RVifthe PDF is 

f z {a)=^—e-¥\ (5.61) 

\I2ti 

The moment generating function for a standardized Gaussian RV can be found as follows: 

M Z (X)= -^- I e'^-^da 
\J2tt J 

— oo 
oo 

= -1- f e-^ a - x)2 - k2) doc. 
\l2iz J 

— oo 

Making the change of variable ft = a — k we find 

00 

M Z (X) = el* [ MPW = e^\ (5.62) 

— oo 

for all real A. We have made use of the fact that the function f z is a bona fide PDF, as treated 
in Problem 42. Using the Taylor series expansion for an exponential, 



, 2 k k\ *-i n\ 

k=0 71=0 



so that all moments of % exist and 



E(z 2k )= { ^, k = 0,1,2,..., (5.63) 

and 

E(z 2k+1 ) = 0, k = 0,1,2,.... (5.64) 

Consequently, a standardized Gaussian RV has zero mean and unit variance. Extending the 
range of definition of M Z {X) to include the finite complex plane, we find that the characteristic 
function is 

4> z {t) = M z {jt) = e- 1 2 t \ (5.65) 

Letting the RV x = az + r\ we find that E(x) = r\ and a 2 = a 2 . For a > 

F x {a) = P(az+ y] <a) = F z ((a - if) /a), 
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22 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

so that x has the general Gaussian PDF 

1 / 1 



/«(«) 



\I2tio 2 



exp 



2a 



-(« - n)' 



(5.66) 



Similarly, with a > and x 

F x {a) 



— oz+ rj we find 
P(— oz+ rj < a) 



1 - F z ((r, - a)/a), 



so that f x is as above. We will have occasion to use the shorthand notation x ~ G(rj, a 2 ) to 
denote that the RV has a Gaussian PDF with mean r) and variance er 2 . Note that if x ~ G(?7, <r 2 ) 
then (a = oz+ rj) 



Mt) 



e ]nt e~ 



(5.67) 



The Gaussian PDF, illustrated with rj = 75 and <r 2 = 25, as well as with r\ = 75 and a 2 = 9 
in Figure 5.9, is a bell-shaped curve completely determined by its mean and variance. As can 
be seen, the Gaussian PDF is symmetrical about the vertical axis through the expected value. 
If, in fact, t] = 25, identically shaped curves could be drawn, centered now at 25 instead of 
75. Additionally, the maximum value of the Gaussian PDF, (27rer 2 ) -1 / 2 , occurs at a = rj. The 
PDF approaches zero asymptotically as a approaches ±oo. Naturally, the larger the value of the 
variance, the more spread in the distribution and the smaller the maximum value of the PDF. 
For any combination of the mean and variance, the Gaussian PDF curve must be symmetrical 
as previously described, and the area under the curve must equal one. 

Unfortunately, a closed form expression does not exist for the Gaussian CDF, which 
necessitates numerical integration. Rather than attempting to tabulate the general Gaussian 
CDF, a normalization is performed to obtain a standardized Gaussian RV (with zero mean 



A/»(a) 



.12 



.08 



.04 




FIGURE 5.9: Gaussian probability density function for rj = 75 and a 2 = 9, 25. 
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and unit variance). If x ~ G(?y, er 2 ), the RV z= (x — rj)/a is a standardized Gaussian RV: 
z ~ G(0, 1). This transformation is always applied when using standard tables for computing 
probabilities for Gaussian RVs. The probability P(ai < x < a 2) can be obtained as 



using the fact that 



Note that 



P( ai < x < a 2 ) = F x (a 2 ) - FM), (5.68) 



FM = FJia - ri)/a). (5.69) 



(5.70) 



FM = -= f e-^dx = 1 - Q(a), 
w2tt J 

— OQ 

where Q(-) is Marcum's Q_function: 

00 

Q(a) = -L le-^ 2 dx. (5.71) 

win J 

a 

Marcum's Q/unction is tabulated in Tables A. 8 and A. 9 for < a < 4 using the approximation 
presented in Section 5.5.1. It is easy to show that 

Q(-«) = 1 - Q(a) = FM- (5.72) 

The error and complementary error functions, defined by 

a 

erf(a)= - / e~ t2 dt (5.73) 



and 

erfc(a) = - f e~ ? dt = 1 - erf(a) (5.74) 

are also often used to evaluate the standard normal integral. A simple change of variable reveals 
that 

erfc(a) = 2 Q(a/V2). (5. 75) 

Example 5.5.1. Compute F z (— 1.74), where z ~ G(0, 1). 



PI: IML/FFX 
MOBK042-05 



P2: IML 

MOBK042-Enderle.cls 



October 30, 2006 19:51 



24 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 
Solution. To compute F z (— 1.74), we find 

FJ.-1.74) = 1 - g(-1.74) = 2(1.74) = 0.04093, 

using (5.72) and Table A. 8. 

While the value a Gaussian random variable takes on is any real number between negative 
infinity and positive infinity, the realistic range of values is much smaller. From Table A.9, 
we note that 99.73% of the area under the curve is contained between —3.0 and 3.0. From 
the transformation z = (x — t])/o, the range of values random variable x takes on is then 
approximately rj ± 3a . This notion does not imply that random variable x cannot take on a value 
outside this interval, but the probability of it occurring is really very small (2(9(3) = 0.0027). 



Example 5.5.2. Suppose x is a Gaussian random variable with r\ = 35 and a 
PDF and then find P(37 < x < 51). Indicate this probability on the sketch. 



10. Sketch the 



Solution. The PDF is essentially zero outside the interval [^ — 3a, rj + 3a] = [5, 65]. The 
sketch of this PDF is shown in Figure 5.10 along with the indicated probability. With 

x — 35 



10 



we nave 



P(37 < x < 51) = P(0.2 < z < 1.6) = F z (1.6) - F z (0.2). 
Hence P(37 < x < 51) = Q(0.2) - Q(1.6) = 0.36594 from Table A.9. 



A/* («) 




FIGURE 5.10: PDF for Example 5.5.2. 
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Example 5.5.3. A machine makes capacitors with a mean value of 25 \xF and a standard deviation 
of 6 \xF. Assuming that capacitance follows a Gaussian distribution, find the probability that the value 
of capacitance exceeds 31 \xF if capacitance is measured to the nearest \iF 

Solution. Let the RV x denote the value of a capacitor. Since we are measuring to the nearest 
\xF, the probability that the measured value exceeds 31 (xF is 

P(31.5 < *) = P(1.083 < z) = Q(1.083) = 0.13941, 

where z = (x — 25)/ '6 ~ G(0, 1). This result is determined by linear interpolation of the CDF 
between equal 1.08 and 1.09. ■ 



5.5.1 Marcum's Q_Function 

Marcum's Q_function, defined by 



V27T J 



da 



has been extensively studied. If the RV z ~ G(0, 1) then 

Q(y) = 1 - F z (y); 



(5.76) 



(5.77) 



i.e., Q(y) is the complement of the standard Gaussian CDF. Note that Q(0) = 0.5, Q(oo) = 0, 
and that F z {—y) = Q{y). A very accurate approximation to Q{y) is presented in [1, p. 932]: 

(5.78) 
(5.79) 



(5.80) 







Q(y) « e-»* h{t), y>0 


where 




1 




l + 0.2316419y' 


and 








h(t) = 


t{a\ + t{fl2 + t( a 3 + K a 4 ' 

s/2it 


The constants are 




I di 

1 0.31938153 

2 -0.356563782 

3 1.781477937 

4 -1.821255978 

5 1.330274429 



The error in using this approximation is less than 7.5 x 10 8 . 
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A very useful bound for Q(a) is [1, p. 298] 



-i« 2 rr --a 2 

ei , , 2 e 2 



-. S(«) < t/ ; • (5. «>l 

7T a + Vff 2 + 4 V 7r a + Va 2 + 0.57T 

The ratio of the upper bound to the lower bound is 0.946 when a = 3 and 0.967 when a = 4. 
The bound improves as a increases. 

Sometimes, it is desired to find the value of y for which Q{y) = q. Helstrom [14] offers 
an iterative procedure which begins with an initial guess yo > 0. Then compute 



ti = (5.82) 

1 + 0.2316419}/, ' J 



and 



y i+1 = U\n(^-\\ , i = 0,l,.... (5.83) 

The procedure is terminated when y, + i s» y, to the desired degree of accuracy. 

Drill Problem 5.5.1. Students attend Fargo Polytechnic Institute for an average of four years with a 
standard deviation of one-half year. Let the random variable x denote the length of attendance and as- 
sume that x is Gaussian. Determine: (a) P(l < x < 3), (b)P(x > 4), (c)P(x = 4), (y)Z^(4.721). 

Answers: 0.5, 0, 0.02275, 0.92535. 

Drill Problem 5.5.2. The quality point averages of 2500 freshmen at Fargo Polytechnic Institute 
follow a Gaussian distribution with a mean of 2.5 and a standard deviation ofO. 7. Suppose grade 
point averages are computed to the nearest tenth. Determine the number of freshmen you would expect 
to score: (a) from 2.6 to 3.0, (b) less than 2.5, (c) between 3.0 and 3.5, (d) greater than 3.5. 

Answers: 167, 322, 639, 1179. 

Drill Problem 5 .5 .3. Professor Rensselaer loves the game of golf. She has determined that the distance 
the ball travels on her first shot follows a Gaussian distribution with a mean of 150 and a standard 
deviation of 17. Determine the value ofd so that the range, 150 ± d, covers 95% of the shots. 

Answer: 33.32. 

5.6 BIVARIATE GAUSSIAN RANDOM VARIABLES 

The previous section introduced the univariate Gaussian PDF along with some general char- 
acteristics. Now, we discuss the joint Gaussian PDF and its characteristics by drawing on our 
univariate Gaussian PDF experiences, and significantly expanding the scope of applications. 
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Numerous applications of this joint PDF are found throughout the field of biomedical engi- 
neering and, like the univariate case, the joint Gaussian PDF is considered the most important 
joint distribution for biomedical engineers. 

Definition 5.6.1. The bivariate RVz = (x, y) is a bivariate Gaussian RV if every linear combi- 
nation ofx and y has a univariate Gaussian distribution. In this case we also say that the RVs x and 
y are jointly distributed Gaussian RVs. 

Let the RV w = ax + by, and let x and y be jointly distributed Gaussian RVs. Then 
w is a univariate Gaussian RV for all real constants a and b. In particular, x ~ G(rj x , o\J) and 
y ~ G{t] y , o^); i.e., the marginal PDFs for a joint Gaussian PDF are univariate Gaussian. The 
above definition of a bivariate Gaussian RV is sufficient for determining the bivariate PDF, 
which we now proceed to do. 

The following development is significantly simplified by considering the standardized 
versions of* and y. Also, we assume that \p Xyy \ < 1, o x ^ 0, and a y ^ 0. Let 

zi = ^h and Z2 = y^b t (584) 

a x Oy 

so that zj ~ G(0, 1) and z 2 ~ G(0, 1). Below, we first find the joint characteristic function 
for the standardized RVs Z\ and Z2, then the conditional PDF f Z2 \ Zl and the joint PDF f Zl>Z2 . 
Next, the results for zi and Zq, are applied to obtain corresponding quantities (/) x ,y, f y \ x and f x „. 
Finally, the special cases p x , y = ±1, a x = 0, and a y = are discussed. 

Since Zi and %2 are jointly Gaussian, the RV t\Z\ + t%z% is univariate Gaussian: 



hz x + t 2 z 2 ~ G(0, t{ + 2ht 2 p + tj). 



Completing the square, 



t{ + 2t\hp + q = (h + Ph) + (1 - p)4' 
so that 

4> Z uzz(h, t 2 ) = E(e JtlZl+jt2Z2 ) = e -\^-pM e -\(h+Ph? _ (585) 

From (6) we have 

oo 

/*,*(«, /S) = — J I(a, t 2 )e~^dt 2 , (5.86) 
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where 



oc 



I{a,t 2 )=— / <t) Xl , Z2 {h<h)e ]ah dt x . 

— oo 

Substituting (5.85) and letting r = t\ + t 2 p, we obtain 

oo 

I{a, t 2 ) = e-\^-P^l— f e -^e- ja{x - ph) dx, 
2n J 

— oo 

or 

I{a,t 2 ) = (j){t 2 )f Zl {a), 
where 

4>(h) = 
Substituting into (5.86) we find 



oo 



and recognize that </> is the characteristic function for a Gaussian RV with mean ap and variance 
1 - p 2 . Thus 

— f , s = Ai*i(^|a) = , .„ exp -— — , (5.87) 

/zi(a) V2tt(1 - p 2 ) V 2(1 - p 2 ) / 

so that 

E(z 2 | z x ) = pzi f5.6^ 

and 

°£n = ! " P 2 - f^9j 

After some algebra, we find 

1 / a 2 -2paB + fi 2 \ 

'"•"'• » = 2,(1 -,»)■/» "H' 2(1 -p») J" ^ 

We now turn our attention to using the above results for zi and z 2 to obtain similar results for 
x and y. From (5.84) we find that 

x = <J x Zi + r] x and j = er,,Z2 + 1 y , 
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so that the joint characteristic function for x and y is 

Consequently, the joint characteristic function for x and y can be found from the joint charac- 
teristic function of %\ and z 2 as 

4> x , y (h , h) = cj> ZuZ2 (a„ti , a y t 2 )e^' h e j ^ h . (5. 91) 

Using (4.66), the joint characteristic function <$> x<y can be transformed to obtain the joint PDF 
f«, y {oc, P) as 

/«,>, P) = — ^ j j </> ZuZ2 (* x h, a y t 2 )e-^-^e-^-^dt x dt 2 . (5.92) 

— oo —oo 

Making the change of variables Ti = a x ti, X2 = 0^2? we obtain 

/,,,(«, p) =-- ^f Zl , Z2 (° ! —r 1 , ^rA ■ (5-93) 

Since 



a x o y \ a x o y 



fx, y (fx, P) = f y \x(P\a)f x (a) 



anc 



/«(«) = —A ( ) 

O x \ &X J 

we may apply (5.93) to obtain 

f y]x {fS\ a ) = }- Mz U 

Oy \ 



-y \ O y 



a - r\ x 



0"v 

Substituting (5.90) and (5.87) into (5.93) and (5.94) we find 



(5.94) 



exp 



(_ _J ( (.a-n,Y _ 2p(a-r, x )(p-r, y ) (P->1>) 2 X\ 



/■>• » = — w, ( i -^ '-^ < SM> 

and 

/ {p . ny . pay ^ \ 

eX Pl 2(WX J 

fyUPM = \ —. (5.96) 

27ta*(l - p 2 ) 
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It follows that 

x - r\ x 



E{y\x) = Tj y + pa 



y 



o. 



and 



By interchanging x with v and a with /?, 



exp 



2(1-P 2 )^ 



/*!,(« 1/3) 



^0-2(1 - p 2) 



E{x\y) = r] x + po x 



y-Vy 



cr v 



and 



cr 2 =a 2 (l-p 2 ). 



(5.97) 



(5.98) 



(5.99) 



(5.100) 



(5.101) 



A three-dimensional plot of a bivariate Gaussian PDF is shown in Figure 5.11. 

The bivariate characteristic function for x and y is easily obtained as follows. Since x and 
y are jointly Gaussian, the RV t\X + t 2 y is a univariate Gaussian RV: 

tix + t 2 y ~ G(tir) x + t 2 r) y , t\a 2 x + 2t\t 2 a x , y + /for?). 



.265 



a =-3 




a = 3 



FIGURE 5.11: Bivariate Gaussian PDF f x Ja, fi) with er* = er,, = 1, ?/„ = 77,, = 0, and p = —0.8. 
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Consequently, the joint characteristic function for x and y is 

<t> x ,yih, t 2 ) = e - 1 2 { ^ +2 ^ a -y +t 2 (T y ) e Jtl ' 1 ' +jt2 ' 1 y, (5.102) 

which is valid for all o xy , o x and a y . 

We now consider some special cases of the bivariate Gaussian PDF. If p = then (from 
(5-95)) 

f Xty (a, p) = f x (a)f y {P); (5-103) 

i.e., RVs x and j are independent. 

As p -+ ±1, from (5.97) and (5.98) we find 



x — r\ x 
E(y\x) ->• r\ y ±o y — 



CT V 



and a . —> 0. Hence, 



x — X] x 
y -► ^±Oy — 



in probability 1 . We conclude that 

f x , y (a, p) = f x (a)S (p-Ti y ± Oy ^^A (5.104) 

for p = ±1. Interchanging the roles of x and y we find that the joint PDF for x and y may also 
be written as 

Ay(a, fi) = f y (fi)8 (a-t lx ± ff.^kj C5.i05; 

when p = ±1. These results can also be obtained "directly" from the joint characteristic function 
for x and y. 

A very special property of jointly Gaussian RVs is presented in the following theorem. 

Theorem 5.6.1. The jointly Gaussian RVs x and y are independent iff p x * = 0. 

Proof. We showed previously that if x and y are independent, then p x ^ y = 0. 

Suppose that p = p x , y = 0. Then f y \ x (P\a) = f y {P). ■ 

Example 5.6.1. Let x and y be jointly Gaussian with zero means, a 2 = a 2 = 1, and p ^ ±1. 
Find constants a and b such that v = ax + by ~ G(0, 1) and such that v and x are independent. 

l As the variance of a RV decreases to zero, the probability that the RV deviates from its mean by more than an 
arbitrarily small fixed amount approaches zero. This is an application of the Chebyshev Inequality. 
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Solution. We have E{v) = 0. We require 

a 2 = a 2 + b 2 +2abp 2 xy = l 

and 

E(vx) = a + bp xy = 0. 

Hence a = —bp x<y and b 2 = 1/(1 — p 2 x ), so that 



1 - p 2 



is independent of x and cr£ = 1. ■ 

5.6.1 Constant Contours 

Returning to the normalized jointly Gaussian RVs Z\ and z^, we now investigate the shape of 
the joint PDF f ZiZl {a, /3) by finding the locus of points where the PDF is constant. We assume 
that \p\ < 1. By inspection of (5.90), we find that f ZlZl {a, ft) is constant for a and p 1 satisfying 

a 2 - Ipafi + p 2 = c 2 , (5.106) 

where c is a positive constant. 

If p = the contours where the joint PDF is constant is a circle of radius c centered at 
the origin. 

Along the line /3 = qa we find that 

a 2 (l - 2pq + q 2 ) = c 2 (5.107) 

so that the constant contours are parameterized by 

±« 
a = =, (5.108) 

71 - 2pq + q 2 



and 



P = H (5.109) 

y/1 - 2pq + q 2 



The square of the distance from a point (a, (5) on the contour to the origin is given by 

d\q) = a 2 + p 2 = / { l + q2 \ . (5.110) 
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Differentiating, we find that d 2 (g) attains its extremal values at q = ±1. Thus, the line P = a 
intersects the constant contour at 

±P = a = , f5.i_7.7J 

^2(1^) 

Similarly, the line ft = —a, intersects the constant contour at 

±« = -a = , f5._7.72j 

72(1^7) 

Consider the rotated coordinates a' = (a + P)j \[2 and ft' = (ft — a)/V2, so that 

a' + /3' , 

and 

The rotated coordinate system is a rotation by tz/4 counterclockwise. Thus 

a 2 - 2pafi + p 2 = c 2 (5.115) 

is transformed into 



a. (5.114) 



a 12 P' 2 c 2 



1 + p 1-p 1-p 

The above equation represents an ellipse with major axis length 2c/*/l — \p\ and minor axis 
length 2c/y/l + \p\. In the a — P plane, the major and minor axes of the ellipse are along the 
lines P = ±a. 

From (5.93), the constant contours for f Xi y{a, P) are solutions to 



Using the transformation 



2 - 2p (°^-) (L^l) + (tZJbL^ = c 2 . (5.117) 



a> = ±(°^ + ^A, f>>=*(L^L-!LZl!l) (5.118) 

V2 V °x °y J V 2 V o> c* / 

transforms the constant contour to (5.116). With a' = we find that one axis is along 

a - rj x _ P-Vy 



a x Oy 
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with endpoints at 

±ccr x ±co y 

V2VTTp V2VTTp 

the length of this axis in the a — ft plane is 







With p 


= we find that the other axis is along 




a-r} x p - r\ y 




<? x cr y 



with endpoints at 



±ca x ±co 



the length of this axis in the a — ft plane is 



Points on this ellipse in the a — /3 plane satisfy (5.117); the value of the joint PDF f x „ on this 
curve is 

expf- ' » V (5.119) 



2na x o y JT^2 ^V 2(1 -p 2 ) 



A further transformation 



a"=^=, fi" 



VI + p VI - p 

transforms the ellipse in the a' — /?' plane to a circle in the a" — fi" plane: 



a" 1 + /3' ; " 



//2 , o//2 f 



2 ' 



1-p 

This transformation provides a straightforward way to compute the probability that the joint 
Gaussian RVs x and y lie within the region bounded by the ellipse specified by (5.117). Letting 
A denote the region bounded by the ellipse in the a — /3 plane and A" denote the image (a circle) 
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in the a" — P" plane, we have 

f f f x , y (a,P)dadp = f f — — — 
J J J J 2na x a,,Jl 



e -i( a "i + p»i) 



where the Jacobian of the transformation is 



J(<*,P) 



x a y ^TTp2 \J{a,p)\ 



da" da^_ 

da ~d~p 

dp" dp" 

~da~ ~d~p 



da" dp'' 



Computing the indicated derivatives, we have 

1 



J(a,P) 



1 



a x 42~J\ + p o y yf2^/l + p 
-1 1 



that 



or* a/2 VI — P O y y/2y/\ - p 
1 



/(«,£) 



o x a yy /l 



>yy - P A 
Substituting and transforming to polar coordinates, we find 

f f f x , y (a,p)dadp= f I — e- 1 2 (a " 2+p " 2) da"dp" 



2jt c/^Jl-p 2 

= 2^ J J 




c 2 /(2-2p 2 ) 

= / e~ u du 


= 1 _ g -c 2 /(2-2p 2 ) 



re 2 r dr d9 



This bivariate Gaussian probability computation is one of the few which is "easily" accomplished. 
Additional techniques for treating these computations are given in [1, pp. 956-958]. 

Drill Problem 5.6.1. Given that x and y are jointly distributed Gaussian random variables with 
E(y\x) = 2 + 1.5 a;, E{x\y) = 7/6 + y/6, and a 2 , = 0.75. Determine: (a) rj x , (b) rj y , (c) a 2 , (d) 
a 2 , and(e) p x<y . 

Answers: 0.5, 1, 9, 2, 5. 
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Drill Problem 5.6.2. Random variables x and y are jointly Gaussian with r\ x = —2, r\ y = 3, 

a 2 = 21, a 2 = 31, and p = -0.3394. With c 2 = 0.2212 in (154), find: (a) the smallest angle 
that either the minor or major axis makes with the positive a axis in the a — /3 plane, (b) the length 
of the minor axis, (c) the length of the major axis. 

Answers: 3, 2, 30°. 

Drill Problem 5.6.3. Random variables x and y are jointly Gaussian with r\ x = —2, r\ y = 3, 
a 2 =21, a 2 = 31, and p = -0.3394. Find: (a) E(y \ x = 0), (b)P(l < y < 10\ x = 0), 
(c)P(-l < x < 7). 

Answers: 0.5212, 0.3889, 2.1753. 



5.7 SUMMARY 

This chapter introduces certain probability distributions commonly encountered in biomedical 
engineering. Special emphasis is placed on the exponential, Poisson and Gaussian distributions. 
Important approximations to the Bernoulli PMF and Gaussian CDF are developed. 

Bernoulli event probabilities may be approximated by the Poisson PMF when np < 10 
or by the Gaussian PDF when npq > 3. For the Poisson approximation use r\ = np. For the 
Gaussian approximation use tj = np and a 2 = npq. 

Many important properties of jointly Gaussian random variables are presented. 

Drill Problem 5.7.1. The length of time William Smith plays a video game is given by random 
variable x distributed exponentially with a mean of four minutes. His play during each game is 
independent from all other games. Determine: (a) the probability that William is still playing after 
four minutes, (b) the probability that, out of five games, he has played at least one game for more than 
four minutes. 

Answers: exp(-l), 0.899. 

5.8 PROBLEMS 

1. Assume x is a Bernoulli random variable. Determine P(x < 3) using the Bernoulli 
CDF table if: (a) n = 5, p = 0.1; (b) n = 10, p = 0.1; (c) n = 20, p = 0.1; (d) n = 5, 
p = 0.3; (e) n = 10, p= 0.3; (f) n = 20, p = 0.3; (g) n = 5, p = 0.6; (h) n = 10, 
p = 0.6; (i) n = 20, p = 0.6. 

2. Suppose you are playing a game with a friend in which you roll a die 10 times. If the 
die comes up with an even number, your friend gives you a dollar and if the die comes 
up with an odd number you give your friend a dollar. Unfortunately, the die is loaded 
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so that a 1 or a 3 are three times as likely to occur as a 2, a 4, a 5 or a 6. Determine: 
(a) how many dollars your friend can expect to win in this game; (b) the probability of 
your friend winning more than 4 dollars. 

3. The probability that a basketball player makes a basket is 0.4. If he makes 10 attempts, 
what is the probability he will make: (a) at least 4 baskets; (b) 4 baskets; (c) from 7 to 
9 baskets; (d) less than 2 baskets; (e) the expected number of baskets. 

4. The probability that Professor Rensselaer bowls a strike is 0.2. Determine the probability 
that: (a) 3 of the next 20 rolls are strikes; (b) at least 4 of the next 20 rolls are strikes; 
(c) from 3 to 7 of the next 20 rolls are strikes, (d) She is to keep rolling the ball until 
she gets a strike. Determine the probability it will take more than 5 rolls. Determine 
the: (e) expected number of strikes in 20 rolls; (f) variance for the number of strikes in 
20 rolls; (g) standard deviation for the number of strikes in 20 rolls. 

5. The probability of a man hitting a target is 0.3. (a) If he tries 15 times to hit the target, 
what is the probability of him hitting it at least 5 but less than 10 times? (b) What 
is the average number of hits in 30 tries? (c) What is the probability of him getting 
exactly the average number of hits in 30 tries? (d) How many times must the man try 
to hit the target if he wants the probability of hitting it to be at least 2/3? (e) What is 
the probability that no more than three tries are required to hit the target for the first 
time? 

6. In Junior Bioinstrumentation Lab, one experiment introduces students to the transistor. 
Each student is given only one transistor to use. The probability of a student destroying 
a transistor is 0.7. One lab class has 5 students and they will perform this experiment 
next week. Let random variable x show the possible numbers of students who destroy 
transistors, (a) Sketch the PMF for x. Determine: (b) the expected number of destroyed 
transistors, (c) the probability that fewer than 2 transistors are destroyed. 

7. On a frosty January morning in Fargo, North Dakota, the probability that a car parked 
outside will start is 0.6. (a) If we take a sample of 20 cars, what is the probability that 
exactly 12 cars will start and 8 will not? (b) What is the probability that the number of 
cars starting out of 20 is between 9 and 15. 

8. Consider Problem 7. If there are 20,000 cars to be started, find the probability that: (a) 
at least 12,100 will start; (b) exactly 12,000 will start; (c) the number starting is between 
11,900 and 12,150; (d) the number starting is less than 12,500. 

9. A dart player has found that the probability of hitting the dart board in any one throw 
is 0.2. How many times must he throw the dart so that the probability of hitting the 
dart board is at least 0.6? 
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10. Let random variable x be Bernoulli with n = 15 and p = 0.4. Determine E(x ). 

11. Suppose x is a Bernoulli random variable with r\ = 10 and <r 2 = 10/3. Determine: 
(a) q, (b) n, (c) p. 

12. An electronics manufacturer is evaluating its quality control program. The current 
procedure is to take a sample of 5 from 1000 and pass the shipment if not more than 1 
component is found defective. What proportion of 20% defective components will be 
shipped? 

13. Repeat Problem 1, when appropriate, using the Poisson approximation to the Bernoulli 
PMF. 

14. A certain intersection averages 3 traffic accidents per week. What is the probability that 
more than 2 accidents will occur during any given week? 

15. Suppose that on the average, a student makes 6 mistakes per test. Determine the 
probability that the student makes: (a) at least 1 mistake; (b) from 3 to 5 mistakes; 
(c) exactly 2 mistakes; (d) more than the expected number of mistakes. 

16. On the average, Professor Rensselaer gives 11 quizzes per quarter in Introduction to 
Random Processes. Determine the probability that: (a) from 8 to 12 quizzes are given 
during the quarter; (b) exactly 11 quizzes are given during the quarter; (c) at least 10 
quizzes are given during the quarter; (d) at most 9 quizzes are given during the quarter. 

17. Suppose a typist makes an average of 30 mistakes per page, (a) If you give him a one 
page letter to type, what is the probability that he makes exactly 30 mistakes? (b) The 
typist decides to take typing lessons, and, after the lessons, he averages 5 mistakes per 
page. You give him another one page letter to type. What is the probability of him 
making fewer than 5 mistakes, (c) With the 5 mistakes per page average, what is the 
probability of him making fewer than 50 mistakes in a 25 page report? 

18. On the average, a sample of radioactive material emits 20 alpha particles per minute. 
What is the probability of 10 alpha particles being emitted in: (a) 1 min, (b) 10 min? 
(c) Many years later, the material averages 6 alpha particles emitted per minute. What 
is the probability of at least 6 alpha particles being emitted in 1 min? 

19. At Fargo Polytechnic Institute (FPI), a student may take a course as many times as 
desired. Suppose the average number of times a student takes Introduction to Random 
Processes is 1.5. (Professor Rensselaer, the course instructor, thinks so many students 
repeat the course because they enjoy it so much.) (a) Determine the probability that a 
student takes the course more than once, (b) The academic vice-president of FPI wants 
to ensure that on the average, 80% of the students take the course at most one time. To 
what value should the mean be adjusted to ensure this? 
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20. Suppose 1% of the transistors in a box are defective. Determine the probability that 
there are: (a) 3 defective transistors in a sample of 200 transistors; (b) more than 15 
defective transistors in a sample of 1000 transistors; (c) defective transistors in a 
sample of 20 transistors. 

21. A perfect car is assembled with a probability of 2 x 10~ . If 15,000 cars are produced 
in a month, what is the probability that none are perfect? 

22. FPI admits only 1000 freshmen per year. The probability that a student will major in 
Bioengineering is 0.01. Determine the probability that fewer than 9 students major in 
Bioengineering. 

23. (a) Every time a carpenter pounds in a nail, the probability that he hits his thumb is 
0.002. If in building a house he pounds 1250 nails, what is the probability of him hitting 
his thumb at least once while working on the house? (b) If he takes five extra minutes 
off every time he hits his thumb, how many extra minutes can he expect to take off in 
building a house with 3000 nails? 

24. The manufacturer of Leaping Lizards, a bran cereal with milk expanding (exploding) 
marshmallow lizards, wants to ensure that on the average, 95% of the spoonfuls will 
each have at least one lizard. Assuming that the lizards are randomly distributed in the 
cereal box, to what value should the mean of the lizards per spoonful be set at to ensure 
this? 

25. The distribution for the number of students seeking advising help from Professor Rens- 
selaer during any particular day is given by 

3 k e~ 3 
P( x = /,) = ——, £ = 0,1,.... 

fcl 

The PDF for the time interval between students seeking help for Introduction to 
Random Processes from Professor Rensselaer during any particular day is given by 

f t (t) = e~ T u(r). 

If random variable z equals the total number of students Professor Rensselaer helps 
each day, determine: (a) E(z), (b) o z . 

26. This year, on its anniversary day, a computer store is going to run an advertising cam- 
paign in which the employees will telephone 5840 people selected at random from the 
population of North America. The caller will ask the person answering the phone 
if it's his or her birthday. If it is, then that lucky person will be mailed a brand 
new programmable calculator. Otherwise, that person will get nothing. Assuming that 
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the person answering the phone won't lie and that there is no such thing as leap year, 
find the probability that: (a) the computer store mails out exactly 16 calculators, (b) the 
computer store mails out from 20 to 40 calculators. 

27. Random variable x is uniform between —2 and 3. Event A = {0 < x < 2} and B = 
{-1 < x < 0} U {1 < x < 2}. Find: (a) P(-l < x < 0), (b) rj x , (c) a x , (d) f x \ A {a\A), 
(e) F xlA (oc\A), (f) f x \ B {a\B), (g) F aM ,(a|5). 

28. The time it takes a runner to run a mile is equally likely to lie in an interval from 4.0 to 
4.2 min. Determine: (a) the probability it takes the runner exactly 4 min to run a mile, 
(b) the probability it takes the runner from 4.1 to 4.15 min. 

29. Assume x is a standard Gaussian random variable. Using Tables A. 9 and A. 10, de- 
termine: (a) P(x = 0), (b) P(x < 0), (c) P(x < 0.2), (d) P(-1.583 < x < 1.471), 
(e) P(-2.1 < x < -0.5), (f) P(x is an integer). 

30. Repeat Problem 1, when appropriate, using the Gaussian approximation to the 
Bernoulli PMF. 

31. A light bulb manufacturer distributes light bulbs that have a length of life that is 
normally distributed with a mean equal to 1200 h and a standard deviation of 40 h. 
Find the probability that a bulb burns between 1000 and 1300 h. 

32. A certain type of resistor has resistance values that are Gaussian distributed with a 
mean of 50 ohms and a variance of 3. (a) Write the PDF for the resistance value, (b) 
Find the probability that a particular resistor is within 2 ohms of the mean, (c) Find 
P(49 < r < 54). 

33. Consider Problem 32. If resistances are measured to the nearest ohm, find: (a) the 
probability that a particular resistor is within 2 ohms of the mean, (b) P(49 < r < 54). 

34. A battery manufacturer has found that 8.08% of their batteries last less than 2.3 years 
and 2.5% of their batteries last more than 3.98 years. Assuming the battery lives are 
Gaussian distributed, find: (a) the mean, (b) variance. 

35. Assume that the scores on an examination are Gaussian distributed with mean 75 and 
standard deviation 10. Grades are assigned as follows: A: 90-100, B: 80-90, C: 70-80, 
D: 60-70, and F: below 60. In a class of 25 students, what is the probability that grades 
will be equally distributed? 

36. A certain transistor has a current gain, h, that is Gaussian distributed with a mean of 77 
andavarianceofll.Find:(a) P(h > 74), (b) P(73 < h < 80), (c) P(\h - r,h\ < 3oi). 

37. Consider Problem 36. Find the value of d so that the range 77 + d covers 95% of the 
current gains. 
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38. A 250 question multiple choice final exam is given. Each question has 5 possible answers 
and only one correct answer. Determine the probability that a student guesses the correct 
answers for 20-25 of 85 questions about which the student has no knowledge. 

39. The average golf score for Professor Rensselaer is 78 with a standard deviation of 3. 
Assuming a Gaussian distribution for random variable x describing her golf game, 
determine: (a) P(x = 78), (b) P(x < 78), (c) P(70 < x < 80), (d) the probability that 
x is less than 75 if the score is measured to the nearest unit. 

40. Suppose a system contains a component whose length is normally distributed with a 
mean of 2.0 and a standard deviation of 0.2. If 5 of these components are removed from 
different systems, what is the probability that at least 2 have a length greater than 2.1? 

41. A large box contains 10,000 resistors with resistances that are Gaussian distributed. If 
the average resistance is 1000 ohms with a standard deviation of 200 ohms, how many 
resistors have resistances that are within 10% of the average? 

42. The RV x has PDF 

f x (a) = aexp ( ~^(« - I?) ■ 

(a) Find the constant a. (Hint: assume RV y is independent of x and has PDF fy((f) = 
f x (j3) and evaluate F x „(oo, oo).) (b) Using direct integration, find E(x). (c) Find erf 
using direct integration. 

43. Assume x and y are jointly distributed Gaussian random variables with x ~ G(—2, 4), 
y ~ G(3, 9), and p XJ = 0. Find: (a) P(l < y < 7 \ x = 0), (b) P(l < y < 7), 

(c) P(-l < x < 1,1 < y < 7). 

44. Suppose x and y are jointly distributed Gaussian random variables with E{y\x) = 
2.8 + 0.32x, E(x\y) = — 1 + 0.5y, and a y \ x = 3.67. Determine: (a) rj x , (b) rj y , (c) a x , 

(d) o y , (e) p x>y , (f) a x>y . 

45. Assume x ~ G(3, 1), y ~ G(—2, 1), and that x andj are jointly Gaussian with p x „ = 
—0.5. Draw a sketch of the joint Gaussian contour equation showing the original and 
the translated-rotated sets of axes. 

46. Consider Problem 45. Determine: (a) E(y\x = 0), (b) f ylK (fi\0), (c) P(0 < y < 4\x = 0), 
(d) P(3 < x < 10). 

47. Assume x and y are jointly Gaussian with x ~ G(2, 13), y ~ G(l, 8), and p x>J , = 
—5.8835. (a) Draw a sketch of the constant contour equation for the standardized RVs 
Zi and %2. (b) Using the results of (a), Draw a sketch of the joint Gaussian constant 
contour for x and y. 
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48. Consider Problem 47. Determine: (a) E(y\x = 0), (b) fy\ n (fi\0), (c) P(0 < 
y<4\x = 0),(d) P(3 < x < 10). 

49. Assume x and _y are jointly Gaussian with x ~ G(— 1, 4), _y ~ G(1.6, 7), and p x „ = 
0.378. (a) Draw a sketch of the constant contour equation for the standardized RVs Zi 
and Z2- (b) Using the results of (a), Draw a sketch of the joint Gaussian contour for x 
and y. 

50. Consider Problem 49. Determine: (a) E(y\x = 0), (b) f y \ x (P\0), (c) P(0 < 

j < 4\x = 0), (d) P(-3 < x < 0). 

51. A component with an exponential failure rate is 90% reliable at 10,000 h. Determine 
the number of hours reliable at 95%. 

52. Suppose a system has an exponential failure rate in years to failure with rj = 2.5. De- 
termine the number of years reliable at: (a) 90%, (b) 95%, (c) 99%. 

53. Consider Problem 52. If 20 of these systems are installed, determine the probability 
that 10 are operating at the end of 2.3 years. 

54. In the circuit shown in Figure 5.12, each of the four components operate independently 
of one another and have an exponential failure rate (in hours) with r\ = 10 . For suc- 
cessful operation of the circuit, at least two of these components must connect A with 
B. Determine the probability that the circuit is operating successfully at 10,000 h. 

55. The survival rate of individuals with a certain type of cancer is assumed to be exponential 
with r] = 4 years. Five individuals have this cancer. Determine the probability that at 
most three will be alive at the end of 2.0433 years. 

56. Random variable t is exponential with r\ = 2. Determine: (a) P(t > rf), (b) f z {a) if 
z= t — T, where T is a constant. 

57. William Smith is a varsity wrestler on his high school team. Without exception, if he 
does not pin his opponent with his trick move, he loses the match on points. William's 



FIGURE 5.12: Circuit for Problem 54. 
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trick move also prevents him from ever getting pinned. The length of time it takes 
William to pin his opponent in each period of a wrestling match is given by: 

period 1 : f x (a) = 0.4598394 exp(-0.4598394a<)w(a:), 
period 2 : f x \ A (ot\A) = 0.2299197 exp(-0.2299197a)«(o'), 
period 3 : f x \ A (pt\A) = 0.1149599 exp(-0.1149599a)«(a), 

where A = {Smith did not pin his opponent during the previous periods}. Assume 
each period is 2 min and the match is 3 periods. Determine the probability that William 
Smith: (a) pins his opponent during the first period: (b) pins his opponent during the 
second period: (c) pins his opponent during the third period: (d) wins the match. 

58. Consider Problem 57. Find the probability that William Smith wins: (a) at least 4 of 
his first 5 matches, (b) more matches than he is expected to during a 10 match season. 

59. The average time between power failures in a Coop utility is once every 1.4 years. 
Determine: (a) the probability that there will be at least one power failure during the 
coming year, (b) the probability that there will be at least two power failures during the 
coming year. 

60. Consider Problem 59 statement. Assume that a power failure will last at least 24 h. Sup- 
pose Fargo Community Hospital has a backup emergency generator to provide auxilary 
power during a power failure. Moreover, the emergency generator has an expected time 
between failures of once every 200 h. What is the probability that the hospital will be 
without power during the next 24 h? 

61. The queue for the cash register at a popular package store near Fargo Polytechnic 
Institute becomes quite long on Saturdays following football games. On the average, 
the queue is 6.3 people long. Each customer takes 4 min to check out. Determine: (a) 
your expected waiting time to make a purchase, (b) the probability that you will have 
less than four people in the queue ahead of you, (c) the probability that you will have 
more than five people in the queue ahead of you. 

62. Outer Space Adventures, Inc. prints brochures describing their vacation packages as 
"Unique, Unexpected and Unexplained." The vacations certainly live up to their ad- 
vertisement. In fact, they are so unexpected that the length of the vacations is random, 
following an exponential distribution, having an average length of 6 months. Suppose 
that you have signed up for a vacation trip that starts at the end of this quarter. What 
is the probability that you will be back home in time for next fall quarter (that is, 9 
months later)? 
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63. A certain brand of light bulbs has an average life- expectancy of 750 h. The failure rate 
of these light bulbs follows an exponential PDF. Seven-hundred and fifty of these bulbs 
were put in light fixtures in four rooms. The lights were turned on and left that way for 
a different length of time in each room as follows: 



ROOM 


TIME BULBS LEFT ON, HOURS 


NUMBER OF BULBS 


1 


1000 


125 


2 


750 


250 


3 


500 


150 


4 


1500 


225 



After the specified length of time, the bulbs were taken from the fixtures and placed 
in a box. If a bulb is selected at random from the box, what is the probability that it is 
burnt out? 
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CHAPTER 6 



Transformations of Random Variables 



Functions of random variables occur frequently in many applications of probability theory For 
example, a full wave rectifier circuit produces an output that is the absolute value of the input. 
The input/output characteristics of many physical devices can be represented by a nonlinear 
memoryless transformation of the input. 

The primary subjects of this chapter are methods for determining the probability dis- 
tribution of a function of a random variable. We first evaluate the probability distribution of 
a function of one random variable using the CDF and then the PDF. Next, the probability 
distribution for a single random variable is determined from a function of two random variables 
using the CDF. Then, the joint probability distribution is found from a function of two random 
variables using the joint PDF and the CDF. 

6.1 UNIVARIATE CDF TECHNIQUE 

This section introduces a method of computing the probability distribution of a function of 
a random variable using the CDF. We will refer to this method as the CDF technique. The 
CDF technique is applicable for all functions z = g(x), and for all types of continuous, discrete, 
and mixed random variables. Of course, we require that the function z : S i->- R*, with z(^) = 
g(x(^ )), is a random variable on the probability space (S, 3, P); consequently, we require z to 
be a measurable function on the measurable space (S, 3) and P(z(£) £ { — oo, +oo}) = 0. 

The ease of use of the CDF technique depends critically on the functional form of g(x). 
To make the CDF technique easier to understand, we start the discussion of computing the 
probability distribution of z = g(x) with the simplest case, a continuous monotonic function 
g. (Recall that if g is a monotonic function then a one-to-one correspondence between g(x) 
and x exists.) Then, the difficulties associated with computing the probability distribution of 
z = g{x) are investigated when the restrictions on g{x) are relaxed. 

6.1.1 CDF Technique with Monotonic Functions 

Consider the problem where the CDF F x is known for the RV x, and we wish to find the CDF 
for random variable z = g(x). Proceeding from the definition of the CDF for z, we have for a 
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46 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

monotonic increasing function g(x) 

F z (y) = P(z = g(x) < Y )= P(x < g-\y)) = F x (g-\y)), (6.1) 

where g~\y) is the value of a for which g(a) = y. As (6.1) indicates, the CDF of random 
variable z is written in terms of F x (a), with the argument a replaced by g~ 1 (y)- 
Similarly, if z = g(x) andg is monotone decreasing, then 

F z (y) = P(z = g(x) <y)= P(x > g-\y)) = 1 - F x (g-\y)-). (6.2) 

The following example illustrates this technique. 

Example 6.1.1. Random variable x is uniformly distributed in the interval to 4. Find the CDF 
for random variable z = 2x + 1. 

Solution. Since random variable x is uniformly distributed, the CDF of x is 

F x (a) : 



0, a < 
a/4, < a < 4 

1, 4 < a. 



Letting g(x) = 2x + 1, we see that g is monotone increasing and that g 1 (y) = (y — l)/2. 
Applying (6.1), the CDF for z is given by 



FJ.r) = F,^f) 


— . 


o, 

(y-i)/8, 


(y - l)/2 < 
< (y - l)/2 < 4 




l, 


4 < (y - l)/2. 


Simplifying, we obtain 








0, 


y<\ 


F z (y) = ■ 


(y - i)/8, 


1 < y < 9 




l, 


9 < y, 


which is also a uniform distribution. 









6.1.2 CDF Technique with Arbitrary Functions 

In general, the relationship between x and z can take on any form, including discontinuities. 
Additionally, the function does not have to be monotonic, more than one solution of z = g{x) 
can exist — resulting in a many-to-one mapping from x to z. In general, the only requirement 
on g is that z = g{x) be a random variable. In this general case, F z {y) is no longer found by 
simple substitution. In fact, under these conditions it is impossible to write a general expression 
for F z {y) using the CDF technique. However, this case is conceptually no more difficult than 
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the previous case, and involves only careful book keeping. 
Let 

A{y) = {x : g(x) < y}. (6.3) 

Note that A(y) = £ -1 ((-oo, y]). Then 

F z {y) = P(g(x) <y) = P(x e ^(y)). (6.4) 

Partition A(y) into disjoint intervals {Aj(y) : z = 1, 2, . . .} so that 

oo 

^(y) = U^(y)- ^ 

1=1 

Note that the intervals as well as the number of nonempty intervals depends on y . Since the 
Aj's are disjoint, 

F z {y) = J2 p ( x e -400). f 6 ^ 

The above probabilities are easily found from the CDF F- If interval ^;(y) is of the form 

A i (y) = (a i (y),b i (y)}, (6.7) 

then 

P(* e 4-(y)) = F,(*,-(y)) - F,(«,-(y)). (<*■*,» 

Similarly, if interval A^{y) is of the form 

^■(y) = k(y),^'(y)], (*.*; 

then 

P(x e 4(y)) = F,(J,-(y)) - F,(«,-(y)-). (<5.i0,l 

The success of this method clearly depends on our ability to partition A{y) into disjoint intervals. 
Using this method, any function g and CDF F x is amenable to a solution for F z (y). The 
following examples illustrate various aspects of this technique. 



Example 6.1.2. Random 

F x {a) = 
Find the CDF for the RVz = x 2 . 



x has the CDF 




0, 


a < —1 


(3a - a 3 + 2)/4, 


-1 < a < 1 


1, 


1 < a. 
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Solution. Letting g(x) = x 2 , we find 

Ay) = g-\(-oc,y])-- 

so that 

f z ( y ) = faJy) - f x ((-Vy)~)- 



0, y <° 

i-s/y, VyI y > o. 



Noting that F x {a) is continuous and has the same functional form for — 1 < a < 1, we obtain 

F z (y) - 



0, y <0 

OVY ~ (VF) 3 )/2, 0<y<l 
1 1 < y. 



Example 6.1.3. Random variable x is uniformly distributed in the interval —3 to 3. Random 
variable z is defined by 



z = g(x) 



Find F z (y). 

Solution. Plots for this example are given in Figure 6.1. The CDF for random variable x is 



-1, 


x < —2 


3* + 5, 


-2 < x < -1 


-3x — 1, 


-1 < x < 


3x — 1, 


< * < 1 


2, 


1 < X. 



F x (a) 



0. 

(a + 3)/6, 

1, 



a < —3 

-3 < a < 3 
3 < a. 



Let v4(y) = g 1 ((— oo, oo)). Referring to Figure 6.1 we find 

0, 



^(y) 



-oo, 



y-5 

3 



U 



-y-1 y + 1 



3 



3 



R 



y <-l 
-1 < y < 2 

2 < y. 



Consequently, 



^(y) 



1^1 



o. 
y + 1 



F„ 



-y-1 



y<-l 
-1 < y <2 

2 < y. 
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. i g(x) 




*^(«) 




-3 -1 

FIGURE 6.1: Plots for Example 6.1.3. 



Substituting, we obtain 

l/y-5 



F z {y) = 



3 



+ 3 + 



0. 

y + i 



-y-l 



y+2 



Note that F z (y) has jumps at y = — 1 and at y = 2. 



y < — 1 

-l < y < 2 

2<y. 



Whenever random variable x is continuous and g(x) is constant over some interval or 
intervals, then random variable z can be continuous, discrete or mixed, dependent on the CDF 
for random variable x. As presented in the previous example, random variable z is mixed due to 
the constant value of g(x) in the intervals — 3 < x < —2 and 1 < x < 3. In fact, z is a mixed 
random variable whenever g{a) is constant in an interval where f x (a) -fi 0. This results in a 
jump in F z and an impulse function in f z . Moreover, z = g(x) is a discrete random variable if 
g{ot) changes values only on intervals where f x {u) = 0. Random variable z is continuous if x is 
continuous and g{x) is not equal to a constant over any interval where f x {a) ^ 0. 
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Example 6.1.4. Random variable x has the PDF 



f x (a) 



(l+a 2 )/6, 
0, 



Find the PDF of random variable z defined by 

z = g(x) = 



x — 1, 

0, 

1, 



-1 < a < 2 
otherwise. 



x < 

< x < 0.5 

0.5 < x. 



Solution. To find f z , we evaluate F z first, then differentiate this result. The CDF for random 
variable x is 



F x (a) 



0, 
(a 3 + 3a + 4)/18, 



a < —1 

-1 < a < 2 
2 < a. 



Figure 6.2 shows a plot of g(x). With the aid of Figure 6.2, we find 

-^(y) = {x :g(x) < yj 
Consequently, 

FJty) = 

] 





(-oo, > 


' + 1], y<-l 


'} = • 


(- 

(- 


-oo 
oo, 


,0], -l<y<0 
0.5], < y < 1 




[ (" 


-oo, 


oo), 1 < y. 


F x (y + 1), 




y<-l 


F,(0), 




-1 < y < 


^(0.5), 




0< y < 1 


1 


» 




i<y- 



H 1 h 



H h 



FIGURE6.2: Transformation for Example 6.1.4. 
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Substituting, 



o, 


y < — 2 


+ 3y + 7)/18, 


-2 < Y < -1 


2/9, 


-1 < y < 


5/16, 


0<y < 1 


1, 


i<y. 



^(y) 



Note that -F z (y) has jumps at y = and y = 1 of heights 13/144 and 11/16, respectively. 
Differentiating F z , 

3y 2 + 6y + 6 



/*(y) 



18 



-(«(y + 2) - »(y + 1)) + — S(y) + — 8(y - 1). 

144 Id 



Example 6.1.5. Random variable x is uniformly distributed in the interval from to 10. Find the 
CDF for random variable z = g(x) = — \n(x). 



Solution. The CDF for x is 



FM 



0, 

a/10, 

1, 



a < 

< a < 10 

10 < a. 



For y > 0, we find 



Ay) 



ln(«) < y} = (« r ,oo), 



so that .F z (y) = 1 — ^((e r ) ). Note that P(x < 0) = 0, as required since ^(x) 
not defined (or at least not real-valued) for x < 0. We find 



\n(x) is 



^ Z (K) 



o, 

i-e- 01 y, 



Y < ln(0.1) 
ln(0.1) < y. 



The previous examples illustrated evaluating the probability distribution of a function 
of a continuous random variable using the CDF technique. This technique is applicable for 
all functions z = g(x), continuous and discontinuous. Additionally, the CDF technique is 
applicable if random variable x is mixed or discrete. For mixed random variables, the CDF 
technique is used without any changes or modifications as shown in the next example. 

Example 6.1.6. Random variable x has PDF 

/,(«) = 0.5(u(a) - u(a - 1)) + 0.5<5(<* - 0.5). 

Find the CDF for z = g(x) = 1/x 2 . 
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Solution. The mixed random variable x has CDF 

0, a < 



F x (a) ■ 
For y < 0, F z (y) = 0. For y > 0, 



0.5a, < a < 0.5 

0.5 + 0.5a, 0.5<a<l 
1, l<a. 



^(y) = {x : x 2 < y] 



-oo, 



v7. 



u 



V7 



,00 , 



so that 

/?*(/) = F m (-1/Jy) + 1 - F,((i/Vy)-). 

Since F x ( — l/^/y) = f° r an rea l y, we have 

0, (i/yy)" < o 

O^y" 1 ' 2 , < (1/Vy)" < 0.5 

0.5 + 0.5y" 1/2 , 0.5 < (1/yy)" < 1 

1, 1 < (1/V7)". 



^(y) = i - 

After some algebra, 

f z (y) 



0, y <1 

0.5-0.5y" 1/2 , l<y<4 
l-0.5y" 1/2 , 4<y. 



Drill Problem 6.1.1. Random variable x is uniformly distributed in the interval — 1 /o¥. Random 
variable z = 3x + 2. Determine: (a) F z (0), (b)F z (l), (c)f z (0), (c)f z (15). 

Answers: 0, 2/15, 1/15, 1/15. 

Drill Problem 6.1.2. Random variable x has the PDF 

f x (a) = 0.5a(u(a) — u(a — 2)). 

Random variable z is defined by 

— 1, x < 1 

x, —1 < * < 1 

1, # > 1. 

Determine: (a) F z (-l/2), {b)F z {l/2), (c)F z (3/2), (d)f z (l/2). 
Answers: 0, 1, 1/16, 1/4. 
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Drill Problem 6.1.3. Random variable x has the PDF 

f x (a) = 0.5a(u(a) — u(a — 2)). 
Random variable z is defined by 

-1, *<0.5 

# + 0.5, 0.5 < x < 1 

3, x > 1. 

Determine: (a) F z (-1), (b)F z (0), (c)F z (3/2), (d)F z (4). 
Answers: 1/4, 1/16, 1/16, 1. 

Drill Problem 6.1.4. Random variable x has PDF 

f x (a) = e~ a - l u{a + 1). 

Random variable z = 1/x 2 . Determine: (a) F z (l/S), (b)F z (l/2), (c)F z (4), (d)f z (4). 
Answers: 0.0519, 0.617, 0.089, 0.022. 

6.2 UNIVARIATE PDF TECHNIQUE 

The previous section solved the problem of determining the probability distribution of a function 
of a random variable using the cumulative distribution function. Now, we introduce a second 
method for calculating the probability distribution of a function z = g{x) using the probability 
density function, called the PDF technique. The PDF technique, however, is only applicable 
for functions of random variables in which z = g(x) is continuous and does not equal a constant 
in any interval in which f x is nonzero. We introduce the PDF technique for two reasons. First, 
in many situations it is much simpler to use than the CDF technique. Second, we will find the 
PDF method most useful in extensions to multivariate functions. In this section, we discuss 
a wide variety of situations using the PDF technique with functions of continuous random 
variables. Then, a method for handling mixed random variables with the PDF technique is 
introduced. Finally, we consider computing the conditional PDF of a function of a random 
variable using the PDF technique. 

6.2.1 Continuous Random Variable 

Theorem 6.2.1. Let x be a continuous RV with PDF f x (a) and let the RV z = g(x) . Assume g 

is continuous and not constant over any interval for which f x ^0. Let 

(x t =oi t (y)=g~ 1 (y), i = l,2,..., (6.11) 



PI: IML/FFX P2: IML 

MOBK042-06 MOBK042-Enderle.cls October 30, 2006 19:53 



54 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 

denote the distinct solutions to gioti) = y . Then 



My) = 2^ i (iv / nm ' ( 6 - 12 ) 



where we interpret 

fx(oii(y)) 



0. 



I^ (1) («,(k))I 
iffMiv) = o. 

Proof. Let h > and define 

/(y, £) = {x : y - h < g(x) < y}. 
Partition I(y, h) into disjoint intervals of the form 

I i (y,h) = (a i (y,h),b i (y,h)), f = 1,2, 



such that 



Then 



By hypothesis, 



I{y,h) = \Jl,{y,h). 



FJLy) - F(y -h) = Y,(fMy> *)) - ^-(«.-(y. *))) 



lim a Ay, h) = lim £,(y, h) = a Ay). 

Note that (for all y with f x (a;(y)) ^ 0) 

,. bi{y,h)-ai{y,h) bAy, h) - aAy, h) 

lim = lim 



*-o h ^°\g(t>i(Y,l>))-gMY,Z>))\ \g (1 K<Xi(Y))\ ' 

and that 

F x (bi(y, h)) - F x (a,(y, h)) 
hm — = f x {<Xi{y)). 

h^o bj(y,h) - a t {y,h) 

The desired result follows by taking the product of the above limits. The absolute value ap- 
pears because by construction we have bj > «,- and h > 0, whereas g^' may be positive or 
negative. ■ 
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Example6.2.1. Random variable x is uniformly distributed in the interval 0-4. Find the PDF for 
random variable z = g(x) = 2x + 1. 

Solution. In this case, there is only one solution to the equation y = 2a + 1, given by U\ = 
(y - l)/2. We easily find g m (a) = 2. Hence 

/,(y) = /,((K-l)/2)/2={ 1 / 8 ' \''" 9 

(J, otherwise. ■ 

Example 6.2.2. Random variable x has PDF 

f x (a) = 0.75(1 - a 2 )(u(a + 1) - u(a - 1)). 

Find the PDF for random variable z = g(x) = 1/x 2 . 

Solution. For y < 0, there are no solutions to g{ai) = y, so that f z (y) = for y < 0. For 
y > there are two solutions to g{cii) = y: 

<Xl(y) = -—=, and a 2 (y)=— = . 
Since y = g(a) = a~ 2 , we haveg'^a) = — 2a~ 3 ; hence, |^^(a;)| = 2/|a,| 3 = 2\y\ 3 ? 2 , and 

My) = ^m u(y). 



Substituting, 



0.75(1 - y-^^d - y-'l 2 ) - + 1 - ^(y 1 / 2 - 1)) 

/«(y) = ^ «(y). 



Simplifying, 



or 



0.75(1 - y-'Xu jy - 1) - + 1 - «( 1 - /)) 
/*(/) = ^ «(y), 



/ Z (K) = 0.75(y-§ - y-i)»(y - 1). 



Example 6.2.3. Random variable x has PDF 



1 

f x (a) = -(1 + a 2 )(u(a + 1) - «(a - 2)). 
6 



Find the PDF for random variable z = g(x) = x 2 . 
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Solution. For y < there are no solutions to g(oii) = y, so that f z (y) = for y < 0. For 
y > there are two solutions to g(ai) = y: 

ai(y) = ~s/y, and a 2 (y) = y/y. 
Since y = g(a) = a 2 , we haveg^(a) = 2a; hence, Ig^^a,)! = 2|a,-| = 2^/y, and 

2y/y 

Substituting, 

1 + y 
/ z (y) = rr-=(«(l - V^ 7 ) - "(-2 - a//) + "(V7 + 1) - «(V7 - 2))«(y). 

12 V7 

Simplifying, 

My) = \Pp-^ ~ Y) - + 1 - u(y - 4))a(y), 

or 

( y -l/2 + yV2)/6, < J/ < 1 

{ (y~ 1/2 + y 1/2 )/12, 1 < y < 4 

0, elsewhere. ■ 



6.2.2 Mixed Random Variable 

Consider the problem where random variable x is mixed, and we wish to find the PDF for 
z = g(x). Here, we treat the discrete and continuous portions of f x separately, and then combine 
the results to yield f z . The continuous part of the PDF of * is handled by the PDF technique. 
To illustrate the use of this technique, consider the following example. 

Example 6.2.4. Random variable x has PDF 

f x (a) = g(«(« + 1) - »(« - 1)) + ^(a + 0.5) + -S(a - 0.5). 

Find the PDF for the RVz = g(x) = e~ x . 

Solution. There is only one solution to g(a) = y: 

otiiy) = -ln(y). 

We have g^'((X\) = —e^ y ' = — y. The probability masses of 1/8 for x at —0.5 and 0.5 are 
mapped to probability masses of 1/8 for z at e a5 and e~ , respectively. For all y > such that 
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\a\(y) ± 0.5 1 > we have 



Combining these results, we find 



., , M-Hy)) 
My) = ■ 



My) = ^-(«(y - e- 1 ) - «(y - *)) + \ky - e°- 5 ) + \ky - e-° s ). m 

6.2.3 Conditional PDF Technique 

Since a conditional PDF is also a PDF, the above techniques apply to find the conditional PDF 
for z = g(x), given event A. Consider the problem where random variable x has PDF f x , and 
we wish to evaluate the conditional PDF for random variable z = g{x), given that event A 
occurred. Depending on whether the event A is defined on the range or domain of z = g(x), 
one of the following two methods may be used to determine the conditional PDF of z using 
the PDF technique. 

(i) If A is an event defined for an interval on z, the conditional PDF, f z \A, is computed by first 
evaluating f z using the technique in this section. Then, by the definition of a conditional 
PDF, we have 

Ua{y\A) = ^, ye A, (6.13) 

and f z \ A (y\A) = for y ft A. 
(ii) If Ais an event defined for an interval on x, we will use the conditional PDF of x to evaluate 
the conditional PDF for z as 

r ( \ji\ V^ fz\A(ai(y)\A) 

/ z \a(y\A) = 2^ i m/ ( ... ■ (6-14) 

~[ \g w {oii{y))\ 

Example 6.2.5. Random variable x has the PDF 

1 

f x (a) = t(1 + a 2 )(u(a + 1) - u(a - 2)). 
6 

Find the PDF for random variable z = g(x) = x , given A = {x : x > 0}. 

Solution. First, we solve for the conditional PDF for x and then find the conditional PDF for 
z, based on f x \j. We have 



,.2\ - ' 



P(A) = -j (l+«>- 
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so that 

f AA {a\A) = — (1 + a 2 )(u(a) - u(a - 2)). 
14 

There is only one solution to y = g(a) = a 2 on the interval < a < 2 where f x \A ^ 0. We 
have a\{y) = y/y and \g^\ai(y))\ = 2yfy. Consequently, 

ftAv 14) = ^ Wy + ^=) («(y) - «(y - 4)). B 

Drill Problem 6.2.1. Random variable x has a uniform PDF in the interval OS. Random variable 
z = 3x + 1 .Use the PDF method to determine: (a) f z (0), (b)f z (6), (c)E(z), (d)a 2 . 

Answers: 13, 48, 0, 1/24. 

Drill Problem 6.2.2. Random variable x has the PDF 

9a 2 , < a < 0.5 

3(1 -a 2 ), 0.5<a<l 
0, otherwise. 



/*(«) 



Random variable z = # 3 .Use the PDF method to determine: (a) f z {\/ 27), (b)f z (l/4), (c)/z|z>i/8 
(l/4|z > 1/8), (rf)/ z (2). 



Answers: 1.52, 0, 3, 2.43. 



Drill Problem 6.2.3. Random variable x has the PDF 

2 



f x (a) = -a(u(a) - u(a - 3)). 

Random variable z = (x — 1) . Lfe the PDF method to determine: (a) f z (l/4), (b)f z (9/4), (c) 
f z[z <i(l/4\z<l),(d)E(z\z<l). 

Answers: 4/9, 5/27, 1/3, 1. 

Drill Problem 6.2.4. Random variable x has the PDF 

fM = -(a + l)(*(a + 1) - u(a - 2)). 
9 

Random variable z = 2* a«^ event A = {x : x > 0}. Determine: (a) P{A), {b)f x \A i\\A), (c) 
f zlA (2\A),(d)f zl A9\A). 

Answers: 0, 1/2, 1/8, 8/9. 
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6.3 ONE FUNCTION OF TWO RANDOM VARIABLES 

Consider a random variable z = g(x, y) created from jointly distributed random variables x 
and y. In this section, the probability distribution of z = g(x, y) is computed using a CDF 
technique similar to the one at the start of this chapter. Because we are dealing with regions in 
a plane instead of intervals on a line, these problems are not as straightforward and tractable as 
before. 

With z = g(x, y), we have 

F£y) = P(z <Y)= P(g(x, y)<y) = P((x, y) e Ay)), (6.15) 

where 

A(y) = {(x,y):g(x,y)<y}. (6.16) 

The CDF for the RV z can then be found by evaluating the integral 

Fz(y) = \ dF x , y (a, ft). 

J Ay) 



(6.17) 



This result cannot be continued further until a specific F x « and g(x, y) are considered. Re- 
member that in the case of a single random variable, our efforts primarily dealt with algebraic 
manipulations. Here, our efforts are concentrated on evaluating F z through integrals, with the 
ease of solution critically dependent on g(x, y). 

The ease in solution for F z is dependent on transforming A(y) into proper limits of 
integration. Sketching the support region for f x „ (the region where f x „ ^ 0, or F x « is not 
constant) and the region A(y) is often most helpful, even crucial, in the problem solution. Pay 
careful attention to the limits of integration to determine the range of integration in which the 
integrand is zero because f x « = 0. Let us consider several examples to illustrate the mechanics 
of the CDF technique and also to provide further insight. 

Example 6.3.1. Random variables x and y have joint PDF 

- , a , f 1/4, 0<a<2,0</3 <2 
fx, y (a, P) = \ . 

U, otherwise. 

Find the CDF for z = x + y . 

Solution. We have A(y) = {(a, P) : a + P < y}. We require the volume under the surface 
f x , y (a, P) where a < y - p-. 



/oo r-Y-P 
/ f x , y (a,p)dadp. 
-CO J —OO 
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P 

P 




o y 2 a 

(a)0<y<2 
FIGURE 6.3: Plots for Example 6.3.1. 




y—2 2 Y a 

(b)2<y<4 



For y < we have F z (y) = 0. For < y < 2, with the aid of Figure 6.3(a) we obtain 



Fjy) 



2 vy-p j 



If 

JO Jo 



-dadfi = —y z 



For 2 < y < 4, referring to Figure 6.3(b), we consider the complementary region (to save some 
work): 

F z (y) = 1 - I I -dad? = 1 - \{A - yf. 

Jy-2 Jy-p 4 O 

Finally for 4 < y, F z (y) = 1. 

Example 6.3.2. Random variables x and y have joint PDF 

' 1, 0<a<l,0<)8<l 



fx, y (a, P) 



0. 



oth 



erwise. 



Find the PDF for z = x — y . 



Solution. We have A{y) = {(a, P) : a — j3 < y}. We require the volume under the surface 
f x , y {a, P) where a < y + P: 



/oo py+p 
-oo »/ — OO 



P)dadp. 



For y < —1 we have .F z (y) = and f z {y) = 0. With the aid of Figure 6.4(a), for — 1 < y < 0, 



'1 /•J'+iS 

F z (y) - 

'-y JO 



J f dadp = -{l 
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1-7 




l+y i 



(a)-l <y<0 
FIGURE 6.4: Plots for Example 6.3.2. 



y j a 

(b)0<y< 1 



so that f z (y) = 1 + y. For < y < 1, we consider the complementary region shown in Fig- 
ure 6.4(b) (to save some work): 



F z {y) = 1 - I I dad? = 1 - -(1 - y) 2 , 

JO Jy+P A 



so that f z iy) = 1 — y. Finally, for 1 < y, F z (y) = 1, so that / z (y) = 0. 
Example 6.3.3. .Ffwaf the CDF for z = x/y, where x and y have the joint PDF 

f x ,y(a, P) 



\/a, < y6 < a < 1 
0, otherwise. 



Solution. We have A(y) = {(a, ft) : a/ f> < y}. Inside the support region for f x<y , we have 
a//3 > 1; hence, for y < 1 we have F z {y) = 0. As shown in Figure 6.5 it is easiest to integrate 
with respect to /3 first: for 1 < y , 



Fziy) = f f -dpda = 1 - - 

JO Ja/y « y 




FIGURE 6.5: Integration region for Example 6.3.3. 
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Example 6.3.4. Find the CDF for z = x + y , where x and y have the joint PDF 



fx.yiot, P) 



3a, < (i < a < 1 



0. 



otherwise. 



Solution. We have ^(y) = {(a, fi) : a 2 + fi 2 < y}. For y < 0, we obtain F z (y) = 0. Trans- 
forming to polar coordinates: a = r cos(9), fi = r s'm(6), 

F z (y)= f f f x , y (rcos(9),rsm(9))rdrd9, 

J J r 2 <y 

Referring to Figure 6.6(a), for < y < 1, 

-7T/4 r-Jy -> 



F z (y) 



/•7T/4 /. A 

Jo Jo 



3r 2 cos(6)dr d9 = —^y' 1 - 
'o Jo v2 



For 1 < y < 2, we split the integral into two parts: one with polar coordinates, the other using 
rectangular coordinates. With 



sin(0i) 



V7 



we find with the aid of Figure 6.6(b) that 

■77/4 Wy 



Fly) 



Je^ Jo 



f 1 r a ^y^ 

3r cos(9)dr d9 + / / 3adfi da, 

Jo Jo 



or 



F z (y) = —yl - (y - 1)1 
s[2 



Finally, we have F z (y) = 1 for 2 < y. 





(b) l<y<2 



FIGURE 6.6: Integration regions for Example 6.3.4. 
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Drill Problem 6.3.1. Random variables x and y have joint PDF 

f x , y (a,/3) = e- a e- (S u(a)u(l3). 
Random variable z = x — y . Find (a) F z (—l/3), (b)f z (—l), (c)F z (l), and (d) fJX). 



Answers: -,e , -,e , 1 — -re , 



\e~\ 



6.4 BIVARIATE TRANSFORMATIONS 

In this section, we find the joint distribution of random variables z = g(x, y) and w = h{x, y) 
from jointly distributed random variables x and y . First, we consider a bivariate CDF technique. 
Then, the joint PDF technique for finding the joint PDF for random variables z and w formed 
from x and y is described. Next, the case of one function of two random variables is treated by 
using the joint PDF technique with an auxiliary random variable. Finally, the conditional joint 
PDF is presented. 

6.4.1 Bivariate CDF Technique 

Let x and y be jointly distributed RVs on the probability space (S, 3, P), and let z = g(x, y) 
and w = h{x, y). Define A{y , \js) to be the region of the x — y plane for which z = g(x, y) < y 
and w = h(x, y) < x[/; i.e., 



Note that 



Then 



Ay, V0 = {(*, y) ■ g(x, y) < y, h{x,y) < f}. (6.18) 

A{y, f) = g -\(-oo, y]) n h'^i-oo, iff]). (6.19) 



F z , w (y,if)= f [ dF Ki y(a, 0). (6.20) 

JA{y,f) J 

It is often difficult to perform the integration indicated in (6.20). 
Example 6.4.1. Random variables x and y have the joint PDF 

, . .. J 0.25, 0<a<2,0<£<2 
(J, otherwise. 

With z = g(x, y) = x + y and w = h(x, y) = y, find the joint PDF f zw . 

Solution. We have 

£ _1 ((-oo, y]) = {(x,y) : x+y < y} 



PI: IML/FFX P2: IML 

MOBK042-06 MOBK042-Enderle.cls October 30, 2006 19:53 



64 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 




FIGURE 6.7: Integration region for Example 6.4.1. 



anc 



h \(-oo,ir]) = {(x,y): y < x[r}. 
The intersection of these regions is 

Ay, f) = i(x,y) : y < min(y - x, f)}, 

which is illustrated in Figure. 6.7. With the aid of Figure 6.7 and (6.20) we find 

/f rv-P 
/ dF Xj y(a, p). 
-00 J — 00 

Instead of carrying out the above integration and then differentiating the result, we differentiate 
the above integral to obtain the PDF f z>w directly. We find 



- = lim — / / dF x Ja,P), 

hl^Q hi J^ooJy^-p 



dy 



and 



d 2 F z , w (y, if) 



lim lim — 



I rt rv-p 

— \ \ dF x Ja, p). 

\"2 Jf-h 2 Jy-ii-p 



Performing the indicated limits, we find that f z , w (y, if) = fx,y(Y ~ if, V r )> substituting, we 
obtain 



fz,w(y, if) 



0.25, <y -if <2,0 <f <2 



0, 



otherwise. 



When the RVs x and y are jointly continuous, it is usually easier to find the joint PDF 
f Z}W than to carry out the integral indicated in (6.20). 
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6.4.2 Bivariate PDF Technique 

A very important special case of bivariate transformations is when the RVs x and y are jointly 
continuous RVs and the mapping determined by g and h is continuous with g and h having 
continuous partial derivatives. Let h\ > 0, h 2 > and define 

I(y, hi, f, b 2 ) = g-\(y - h, y]) n h-\(f - h 2 , f]). (6.21) 

Partition / into disjoint regions so that 

I(y, h x , f, h 2 ) = |J I { (y, h x , f, h 2 ). (6.22) 

i 

Let (a,, fa) denote the unique element of 

lim lim Ii{y, h\, ill, h 2 ). 

Then for small h\ and small h 2 we have 

h\h 2 f v , w {y, jf)^y2 f*.v( a i> A) / da dp. (6.23) 

i J iAy.hLf.h2) 

Dividing both sides of the above by h\h 2 and letting h\ — >■ and h 2 — >• 0, the approximation 
becomes an equality The result is summarized by the theorem below. 

Theorem 6.4.1. Let x and y be jointly continuous RVs with PDF f xy , and let z = g(x, y) and 
w = h(x, y) . Let 



{ai{y,ir),Pi{y,ir)), i = l,2,. 
be the distinct solutions to the simultaneous equations 

g(a u Pi) = y 
and 

h(a„p i ) = f. 
Define thejacobian 

dg(a, P) dg{oc, P) 

JW,P) 



(6.24) 



(6.25) 



(6.26) 



da dp 

3h(a,p) 3h(a,p) 



da 



(6.27) 
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where the indicated partial derivatives are assumed to exist. Then 



fz,w(y, if) = zl 



fx,y(0ti,Pi) 



i !/(«,■, &) | ' 



(6.28) 



The most difficult aspects to finding f z>m using the joint PDF technique are solving the si- 
multaneous equations y = gipti, Pi) and \[r = h{ai, Pi) for a- t and Pi, and determining the 
support region for f z , w . Let us consider several examples to illustrate the mechanics of this 
PDF technique. 

Example 6.4.2. Random variables x and y have the joint PDF 



fx, y (a, P) 



1/4, <a <2,0 < P <2 



0. 



otherwise. 



Find the joint PDF for z = g{x, y) = x + y and w = h(x, y) = y. 

Solution. There is only one solution toy = a + P and ty = P m . a.\ = y — r/f and Pi = iff. The 
Jacobian of the transformation is 



/ 



1 1 
1 



1-1-1-0 = 1. 



Applying Theorem 1, we find 



r , M f X ,y(<Xl,Pl) 

fzAy, yjr) = y 



f x .y(y - f, if)- 



Substituting, we obtain 

fz,w(y, if) - 

The region of support for f AW is illustrated in Figure 6.8. 



1/4, <y -if <2,0 <f <2 
0, otherwise. 



Example 6.4.3. Random variables x and y have the joint PDF 

\l2ap(l-a), 0<a<l,0<p<l 
x ' y 0, otherwise. 

Find the joint PDF for z = g(x, y) = x 2 y and w = h(x, y) = y. 
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FIGURE 6.8: Support region for Example 6.4.2. 

Solution. Solving y = a 2 p and x\t = P, we find a\ = y/y/xfr and P\ = xfr . The other solution 
a 2 = — ot\ is not needed since f xv (a, /3) = for a < 0. The Jacobian is 



h 



1 



2ai/Ji = 2^/yxj/. 



Applying Theorem 1, we find 

fx, y (Vy7W> f) 



f z ,w(y, f) 



2^/yxjr 

6(l-Vy7W). < J7JW < 1,0 < iA < 1 
0, otherwise. 



Example 6.4.4. Random variables x and y have the joint PDF 

. . oS fo.25(a + l), -1<«<1,-1<j8<1 

fx,y(ce, P)=\ n A • 

(J, otherwise. 

Find the joint PDF for z = ?(#, _y) = #_y and w = h(x, y) = j//#. 

Solution. Solving y = a/5 and ^ = jS/a, we find a = y/f) = P/xJ/, so that p 2 = yxfr. Let- 
ting Pi = ■s/yx// we have a\ = s/yjxj/. Then p 2 = — \/yx/s and «2 = —W7W- Note that the 
solution (ai, ySi) is in the first quadrant of the a — P plane; the solution (a 2 , Pi) is in the third 
quadrant of the a — p plane. We find 



/ 



P a 

-P/a 2 l/o 



,P 



a 



so that/i = 2xj/ = J 2 . Hence 



f , , v _ f x , y Wy/f, WW) , f x , y (-s/y/^, 
jz, w \ y ? v / — «... 



^yi/7) 



2|VI 



2|VI 
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In the y — if plane, 



fx, y Wy/jf, WW) 
2\f\ 

has support region specified by 

< y] y l^t < 1 and < s/yif < 1, 

or 

y 

< — < 1 and < yx// < 1. 
ifr 

Similarly, 



fx, y (-^y/f,-VyW) 
2\f\ 

has support region specified by 

— 1 < —yfylir < and — 1 < — y ynjs < 0, 

or 

y 
< — < 1 and < y\js < 1. 

Consequently, the two components of the PDF f z>w have identical regions of support in 
the y — if plane. In the first quadrant of the y — if plane, this support region is easily seen to be 
< y < if < y~ x ■ Similarly, in the third quadrant, the support region is y~ l < ir < y < 0. 
This support region is illustrated in Figure 6.9. Finally, we find 

I l/(4\x//\), < y < ir < y"\ or y~ l < \fr < y < 

U, otherwise. ■ 

Auxiliary Random Variables 

The joint PDF technique can also be used to transform random variables x and y with joint 
PDF f xy to random variable z = g(x, y) by introducing auxiliary random variable w = h{x, y) 
to find f ZiW and then finding the marginal PDF f z using 



/oo 
-OO 



,(Y, f)dif- (6.29) 



It is usually advisable to let the auxiliary random variable w equal a quantity which allows 
a convenient solution of the Jacobian and/or the inverse equations. This method is an alternative 
to the CDF technique presented earlier. 
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FIGURE 6.9: Support region for Example 6.4.4. 

Example 6.4.5. Random variables x and y have the joint PDF 

' 4ap, 0<a<l,0<j8<l 



fx,y(a, P) 



0. 



otherwise. 



Find the PDF for z = g(x , y) = x . 

Solution. Let auxiliary variable w = h(x, y) = y. Solving y = a 2 and i/r = P, we find a = 
±s/y and P = ijj . The only solution inside the support region for f x ^ y is a = ^fy and P = \fr. 
The Jacobian of the transformation is 



/ 



2a 
1 



so 



that 



f z , w (y, if) 



Ay(*/Y, if) 



AJy^r 



2^Y 



2a, 



2f, 



0, 



2Jy 

We find the marginal PDF for z as 

/oo pi 

fz,w(y, ir)dir = I 2f dx[r. 
-oo JO 

for < y < 1 and f z {y) = 0, otherwise. 



0<y<l,0<V<l 
otherwise. 
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1 

FIGURE 6.10: Support region for Example 6.4.6. 

Example 6.4.6. Random variables x and y have the joint PDF 

' 4afi, 0<a<l,0</?<l 



fx, y (a, P) 



0, 



oth 



erwise. 



Find the PDF for z = g(x, y) = x + y. 

Solution. Let auxiliary variable w = h{x, y) = y. Solving y = a + j3 and x[r = /3, we find 

a = y — xfr and /3 = x[r. We find 



J 



so that 



fz,w(y, f) = fx.yiy - &, f) 



1 1 

1 



4(y — x[r)i(r, < y — x// < 1,0 < xfr < 1 



0, 



otherwise. 



The support region for f z ^ w is shown in Figure 6.10. Referring to Figure 6.10, for < y < 1, 



My) = I 

Jo 



Y 2 o 

4(y — i/OiA d\j/ = -y . 



For 1 < y < 2, 



Otherwise, f z = 0. 



My) = f 

Jy-\ 



A{y - f)f d\jr = --y 3 + Ay - -. 



Conditional PDF Technique 

Since a conditional PDF is also a PDF, the above techniques apply to find the conditional PDF 
for z = g(x, y), given events. Consider the problem where random variables x andj have joint 
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PDF f x ,y, and we wish to evaluate the conditional PDF for random variable z = g{x, y), given 
that event A occurred. Depending on whether the event A is defined on the range or domain of 
z = g(x, y), one of the following two methods may be used to determine the conditional PDF 
of z using the bivariate PDF technique. 

i. If A is an event defined for an interval on z, the conditional PDF, f z \j, is computed by first 
evaluating f z using the technique in this section. Then, by the definition of a conditional 
PDF, we have 

fzUrl^ = jj4> y^ A - ( 6 - 3 °) 

ii. If A is an event defined for a region in the x — y plane, we will use the conditional PDF 
fx, y \A to evaluate the conditional PDF f z \j as follows. First, introduce an auxiliary random 
variable w = h(x, y), and evaluate 

f,«Ay, »I4) = E f -;f< Y " n'Hf' IT • < 6J1 > 

*-[ \J(ai(y,f),Pi(y,f))\ 

where (a,, /?,), i = 1,2, . . ., are the solutions to y = g{a, fi) and ifr = h{a, fi) in region 
A. Then evaluate the marginal conditional PDF 

fzMA(Y^\4)d^- (6.32) 

-oo 

Example 6.4.7. Random variables x and y have joint PDF 

f {a 6) = I 3a ' < ^ < a < 1 

' y ' I 0, otherwise. 

Find the PDF for z = x + y, given event A = {rmx(x, y) < 0.5}. 

Solution. We begin by finding the conditional PDF for x and y, given A . From Figure 6.11(a) 
we find 

p p />0.5 pa I 

P(A) = f Xty (a, P)da d/3= 3a dp da = -; 

consequently, 

fx,y{0t, P) 



f x ,y\A<X, M 



24a, < p < a < 0.5 
P(A) 

0, otherwise. 



PI: IML/FFX P2: IML 

MOBK042-06 MOBK042-Enderle.cls October 30, 2006 19:53 



72 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 




FIGURE 6.11: Support region for Example 6.4.7. 

Letting the auxiliary random variable w = h{x,y) = y, the only solution to y = g(a, /3) = 
a + /3 and x// = h(a, fi) = f$ is a = y — r/r and /3 = \[r. The Jacobian of the transformation is 
/ = 1 so that 



/z,w\j(y> f\ A ) 



fx, y \Ay - f, f\4) 



Substituting, we find 



fz, w \A(Y, ir\d) 



24(y -ifr), 0<if<y-x[r<0.5 



0, 



otherwise. 



The support region for f z , w \j is illustrated in Figure 6.11(b). The conditional PDF for z, given 
A, can be found from 



/oo 
-oo 



]A (y,f\A)df. 



The integration is easily carried out with the aid of Figure 6.11(b). For 0.5 < y < 1 we have 



/ z \a(y\A)= f 24{y-f)dif = 9y 2 . 
Jo 

For 0.5 < y < 1 we obtain 

Ua(y\A) = / 24(y - f)df = 3(1 - y 2 ). 

■/y-0.5 

For y < or y > 1, f z \ A (y\A) = 0. 
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Drill Problem 6.4.1. Random variables x and y have joint PDF 

f X:y (a,/3) = e- a - fS u(a)u(l3). 
Random variable z = x and w = xy. Find: (a) f z , w (l, 1)> (^)f z ,w(~ 1> 1)- 
Answers: 0, e~ 2 . 
Drill Problem 6.4.2. Random variables x and y have joint PDF 

(a B)= \ 4a ^ 0<«<1,0</8<1 

0, otherwise. 

Random variable z= x + y and w = y . Determine: (a) f ZiW (l, 1/4), ($?)f z (—l/2), (c)f z (l/2), 
(d)f z (3/2). 

Answers: 0, 1/12, 1, 13/12. 

Drill Problem 6.4.3. Random variables x and y have joint PDF 

, . a . fl.2(a 2 + /3), 0<a<l,0 <y 6<l 
U, otherwise. 

Random variable z = x y. Determine: (a) f z (—l), (b)f z (l/4), (c)f z (l/2), (d)f z (3/2). 

Answers: 0.7172, 0, 0, 1.3. 

Drill Problem 6.4.4. Random variables x and y have joint PDF 

(a B)= I 2 ' 6 ' ° <a <1 > 0< P <1 
x ' y ' 0, otherwise. 

Random variable z= x — y and event A= {(x,y) : x+y < 1}. Determine: (a) f z \j(—3/ 
2\A), {b)f A A-V2\A), (c)F zlA (0\A), (d)f 4 AV2\A). 

Answers: 0, 3/4, 15/16, 3/16. 

6.5 SUMMARY 

This chapter presented a number of different approaches to find the probability distribution of 
functions of random variables. 

Two methods are presented to find the probability distribution of a function of one random 
variable, z = g{x). The first, and the most general approach, is called the CDF technique. From 
the definition of the CDF, we write 

Fjy) = P(z <y)= P(g(x) < y) = P(x e A{y)), (6.33) 
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where A{y) = [x : g{x) < y}. By partitioning A{y) into disjoint intervals, the CDF F z maybe 
found using the CDF F x . The second approach, called the PDF technique, involves evaluating 

My) = 2^ i (1) / / xxr fa J 4 

~{ \g w (<Xi(y))\ 

where 

«« = a,(y) = £ _1 (y), 1 = 1,2,..., f<5.J5J 

denote the distinct solutions to g(a ; ) = y. Typically, the PDF technique is much simpler to 
use than the CDF technique. However, the PDF technique is applicable only when z = g(x) 
is continuous and does not equal a constant in any interval in which f x is nonzero. 

Next, we evaluated the probability distribution of a random variable z = g(x, y) created 
from jointly distributed random variables x and y using two approaches. The first approach, a 
CDF technique, involves evaluating 

Fjy) = P(z <y)= P(g(x, y) < y) = />((*, y) e A(y)), (6.36) 

where 

4y) = {(*.^):^(*.j')<y}- (6-37) 

The CDF for the RV z can then be found by evaluating the integral 

F z (y) = f dF x , y (a, p). (6.38) 

Ja( y ) 

The ease of solution here involves transforming A{y ) into proper limits of integration. We wish 
to remind the reader that the special case of a convolution integral is obtained when random 
variables x and y are independent and z = x + y. The second approach involves introducing 
an auxiliary random variable and using the PDF technique applied to two functions of two 
random variables. 

To find the joint probability distribution of random variables z = g(x, y)zndw = h{x, y) 
from jointly distributed random variables x and y, a bivariate CDF as well as a joint PDF 
technique were presented. Using the joint PDF technique, the joint PDF for z and w can be 
found as 

fUY,*) = t, & ai ' P ? r (6-39) 

where 

(a,(y, f), pi(y, f)), i = 1, 2 (6.40) 
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are the distinct solutions to the simultaneous equations 

g(oti,Pi) = y (6.41) 

and 



The Jacobian 



J(a,P) 



h{a i ,p i ) = f- 



dg(a, P) dg(a, jS) 
3a 9/3 

dh{a,p) dh{a,p) 



(6.42) 



3a 



d{5 



(6.43) 



where the indicated partial derivatives are assumed to exist. Typically, the most difficult aspect 
of the joint PDF technique is in solving the simultaneous equations. The joint PDF technique 
can also be used to find the probability distribution for z = g(x, y) from f x ^ y by introducing an 
auxiliary random variable w = fo(x,y)to find f ZyW , and then integrating to obtain the marginal 
PDF/ Z . 

6.6 PROBLEMS 

1. Let random variable x be uniform between and 2 with z = exp(x). Find F z using the 
CDF technique. 

2. Given 



/*(<*) 



0.5(1 + a), -l<a<l 
0, otherwise, 



and 



1, 



x < 



x + 1, x > 0. 



Use the CDF technique to find F z . 
3. Suppose random variable x has the CDF 



F x (a) 



0, 

2 



a 



1, 



a < 

< a < 1 

1 < a 



and z = exp(—x). Using the CDF technique, find F z . 
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4. The PDF of random variable x is 

1 



Ma) 



-e 2 



i(«+2), 



(a + 2). 



Find -F z using the CDF technique when z = \x\. 
5. Suppose random variable x has the PDF 



f x (a) 



Random variable z is defined by 



2a, < a < 1 
0, otherwise. 



-1, * < -1 

#, —1 < x < 1 

1, * > 1. 



Using the CDF method, determine i^. 

6. Random variable x represents the input to a half-wave rectifier and z represents the 
output, so that z = u{x). Given that x is uniformly distributed between —2 and 2, find: 
(a) E{z) using f x , (b) F z using the CDF method, (c) f z , (d) E{z) using f z (compare 
with the answer to part a). 

7. Random variable x represents the input to a full-wave rectifier and z: represents the 
output, so that z = \x\. Given that x is uniformly distributed between —2 and 2, find: 
(a) E(z) using f x , (b) F z using the CDF method, (c) f z , (d) E{z) using f z (compare 
with the answer to part a). 

8. Random variable x has the PDF f x (a) = e~ a u(a). Find F z for z = x 2 using the CDF 
method. 



9. Gi 



/» 



1 + a 2 



and 



-1, 

x, 
2. 



x < — 1 

-1 < * < 2 

# > 2. 



Determine: (a) a, (b) F z . 
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10. Random variables x and z are the input and output of a quantizer. The relationship 
between them is defined by: 



0. 


x < 0.5 


1. 


0.5 <x < 1.5 


2. 


1.5 < x <2.5 


3. 


2.5 < x < 3.5 


4. 


x > 3.5. 



Given that the input follows a Gaussian distribution with x ~ G(2.25, 0.49), find f z 
using the CDF method. 

11. Random variable x has the PDF f x (a) = e - a u(a). With z = 100 - 25*, find: (a) i^ z 
using the CDF technique, (b) F z using the PDF technique. 

12. Random variable x has the following PDF 



fx(a) 



4a 3 , < a < 1 
0, otherwise. 



Find the PDFs for the following random variables: (a) z = x 3 , (b) z = (x — 1/2) 2 , (c) 
z= (x-1/4) 2 . 

13. Random variable x has the CDF 



F x (a) 



0, 

(a 2 + 2a + l)/9, 

1, 



a < —1 
-1 < a <2 
2<a 



anc 



0, 



x < -0.5 

-0.5 < x < 

< x. 



Determine F z . 
14. Suppose 



f x (oc) 



(l + a 2 )/6, -l<a<2 

0, otherwise. 



Let z = 1/x 2 . Use the CDF technique to determine F z . 
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FIGURE 6.12: Plot for Problem 15. 



15. Random variable x has the CDF 



F x (a) 



0, 

0.25(a + 1), 

1, 



a < — 1 

-1 < a < 3 

3 < a. 



Find the CDF F z , with RV z = g(x), and g(x) shown in Figure 6.12. Assume that 
g(x) is a second degree polynomial for x > 0. 

16. The voltage x in Figure 6.13 is a random variable which is uniformly distributed from 
— 1 to 2. Find the PDF f z . Assume the diode is ideal. 

17. The voltage x in Figure 6.14 is a Gaussian random variable with mean r\ x = and 
standard deviation a x = 3. Find the PDF f z . Assume the diodes are ideal. 

18. The voltage x in Figure 6.15 is a Gaussian random variable with mean r) x = \ and 
standard deviation a x = 1. Find the PDF f z . Assume the diode and the operational 
amplifier are ideal. 

19. Random variable x is Gaussian with mean r\ x = and standard deviation a x = 1. With 
z = g(x) shown in Figure 6.16, find the PDF f z . 



o- 

+ 



>r 



AA/V 
ik a 



o 



3K£l 



o- 



FIGURE 6.13: Circuit for Problem 16. 



-O 
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-O 




FIGURE 6.14: Circuit for Problem 17. 

20. Random variable x has the following PDF 

'a + 0.5<5(a-0.5), 0<a<l 
0, otherwise. 



/*(«) 



Find F z if z = x 2 . 

21. Random variable x is uniform in the interval to 12. Random variable z = Ax + 2. 
Find _/" z using the PDF technique. 

22. Find f z if z = l/« 2 and % is uniform on —1 to 2. 

23. Random variable x has the PDF 



/*(«) 



2(a + l)/9, 



-1 < a < 2 



0, otherwise. 

Find the PDF of z = 2« 2 using the PDF technique. 
24. Let z = cos(«). Find / z if: 

1/jt, \a\ < n/2 



(a) f x (a) 



0, otherwise. 







M 








AAA 






VVV 






IKQ. 

AAA 




-^^^^ 




+ 


VVV 






+ ^^ 


+ 


X 








z 


- 






- 



FIGURE 6.15: Circuit for Problem 18. 
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a Z = g(x) 




FIGURE 6.16: Transformation for Problem 19. 

(b) /,(«) = 
25. Given that * has the CDF 




0, 
a, 
1, 



< a < tt/2 
otherwise. 



a <0 

< a < 1 

1 < a. 



Find the PDF of z = —2ln(x) using the PDF technique. 
26. Random variable x has the PDF 



/«(«) 



2a/9, 

0, 



< a < 3 
otherwise. 



Random variable z = (x — 1) and event ^4 = {« : * > 1/2}. Find the PDF of random 
variable z, given event A. 

27 '. Random variable x is uniform between —1 and 1. Random variable 



x\ 



x < 

* > 0. 



Using the PDF technique, find f z . 

28. A voltage v is a Gaussian random variable with r] v = and a„ = 2. Random variable 
w = i> 2 /i? represents the power dissipated in a resistor of RQ with <y volts across the 
resistor. Find (a) f w , (b) f w \j if yf = {v > 0}. 
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29. Random variable x has an exponential distribution with mean one. If z = e~ x , use 
the PDF technique to determine: (a) f z \A(y\A) if A = {x : x > 2}, (b) / z \b(y\B) if 
B = {z:z< 1/2}. 

30. Find f z if z = 1/x and 



7r(a 2 + l) 
31. Given that random variable x has the PDF 



/» 



a, < a < 1 

2 — a, 1 < a < 2 

0, otherwise. 



Using the PDF technique, find the PDF of z = x 2 . 
32. Suppose 



fx(a) 



2a, < a < 1 
0, otherwise, 



and z = Sx 3 . Determine f z using the PDF technique. 
33. Given 



/.(a) 



9a 2 , < a < 0.5 

3(1 -a 2 ), 0.5 < a < 1 
0, otherwise, 



and z = —2ln(x). Determine: (a) f z , (b) F z , (c) E(z), (d) ^(z 2 ). 

34. Using the PDF technique, find f z if z = \x\ and x is a standard Gaussian random 
variable. 

35. Suppose RV x has PDF f x {a) = 0.5a(u(a) — u(a — 2)). Find a transformation g such 
that z = ?{x) has PDF 



fz(y) = cy 2 (u(y) - u(y - 1)). 



36. Let 



fx(<x) 



0.75(1 - a 2 ), 
0, 



— 1 < a < 1 
otherwise, 



and z= x 2 . Determine f z using the PDF technique. 
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37. Find f z if z = sin(«) and 

' 1/(2*), 



38. Random variable x has the PDF 

/*(<*) : 



0. 



0.5, 

0.5 - 0.25a, 

0, 



(a) Find the transformation z = g(x) so that 

My) ~- 



1 - 0.25y, 

0.5 - 0.25y, 

0, 



< a < 2jt 
otherwise. 



-1 < a < 
<a <2 
otherwise. 



< y < 1 

1 < y < 2 
otherwise. 



(b) Determine /^ if z = (2* + 2)u(x). 
39. Let random variable x have the PDF 



/*(«) 



1/12, 

1/4, 



—2 < a < 1 

1 < a < 2; 



in addition, P(x = —2) = P(x = 2) = 0.25. If z = l/#, find / z . 

40. Random variable x has PDF 

/,(«) = -«(o + 1) + -5(a) + («(a) - »(a - 2)). 
4 4 

Random variable z = g(x), with ^ shown in Figure 6.17. Find the PDF f z . 

41. Random variable x has PDF 

„2 



/•(a) 



a 



(w(a + 1) — «(a — 2)). 



iZ = g(x) 



-1 

FIGURE 6.17: Transformation for Problem 40. 
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. i z = g(x) 




-1 
FIGURE 6.18: Transformation for Problem 41. 

Random variable z = g(x), with g shown in Figure 6.18. Use the PDF technique to 
find: (a) f z , (b) f z \ A with A = [x > 0}. 

42. The PDF for random variable x is f x (a) = e~ a u{a). With z = e~ x , determine: (a) 
/z\a{y\A) where A = {x : x > 2}, (b) / z \b(y\B) where B = {z : z < 1/2}. 

43. The joint PDF of x and y is 



f x , y (<x,P) 



0, 



< p < a 
otherwise. 



With z = x + y, write an expression(s) for F z {y) (do not solve, just write the integral(s) 
necessary to find F z . 

44. If z = x/y, find F z when x and y have the joint PDF 



f x ,y(ot,P) 



0.25a, < P < a < 1 
0, otherwise. 



45. Resistors Ri and Ri have values rj and r2 which are independent RVs uniformly 
distributed between 1 Q and 2 £2. With r denoting the equivalent resistance of a series 
connection of R\ and R2, find the PDF f r using convolution. 

46. Resistors R\ and R2 have values rj and r2 which are independent RVs uniformly 
distributed between 1 Q and 2 £2. With g denoting the equivalent conductance of a 
parallel connection of R\ and Ri, find the PDF f g using convolution. 

47. Suppose the voltage v across a resistor is a random variable with PDF 



fv(a) 



6a(l — a), 
0, 



< a < 1 
otherwise, 
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and that resistance r is a random variable with PDF 

J 1/12, 94 < /J < 106 
(J, otherwise. 

Moreover, suppose that w and r are independent random variables. Find the PDF for 
power, p = i? /r . 

48. The joint PDF for random variables x and y is 

, g )= \a + p, O<a<l,O<0<l 

' y ' 0, otherwise. 

Let z = 2x + y and w = x + 2y. Find f Z}W . 

49. The joint PDF for random variables x and y is 

( )= J4«/3, O<a<l,O<0<l 
x,y ' 0, otherwise. 

Let z = x 2 and w = xy. Find: (a) f ZtW , (b) _/^. 

50. The joint PDF for random variables x and y is 

, (a «) = J 3 ^ 2 + ^)' ° < P < a < : 
' 0, otherwise. 

Find the joint PDF for random variables z = x + y and w = x — y. 

51. The joint PDF for random variables x and y is 

\0.5/3e- a , 0<a,0</3<2 
' 0, otherwise. 

With z = y/x, find f z . 

52. The joint PDF for random variables x and y is 

<a 2 + p 2 < 1,0 <a,0 < 



" ' 0, otherwise. 

Let A = {(x, y) : x > y}, z = x and iv = x 2 + _y 2 . Find: (a) f z ,w\A, (b) _/z|^- 
53. The joint PDF for random variables x and jy is 

J 1/a, < ^ < a < 1 
(J, otherwise. 

Let z = #/j/ and to = _y. Find f ZyW . 
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54. The joint PDF for random variables x and y is 

f ( R\ - \ asm (P}> 0<a<l,0</J<7T 
' 0, otherwise. 

Let z = x 2 and w = cos(y). Find f z ,w 

55. The joint PDF for random variables x and y is 

. , oS [ 12a/3(l - a), 0<«<1,0<jS<1 
U, otherwise. 

Let z = « 2 j. Find _/~ z . 

56. The joint PDF for random variables # and _y is 

, , fl x f'~ a ^> 0<a,0 <y 6 
/*,,(a./3)=j n ., . 

(J, otherwise. 

Let z = x + j and to = x/{x + j/). Find: (a) f ZyW , (b) _/^. 

57. The joint PDF for random variables x and y is 

. . „, \0.25(a + /3), \a\ < 1, |0| < 1 
(J, otherwise. 

Let z = xy and w = y/x. Find y^, TO using the joint CDF technique. 
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TABLE A.l: 


Bernoulli CDF for r 


= 5 and n — 


10 












n - 


= 5 






/ 


k 


+0 


+1 


+2 


+3 


+4 


0.05 





0.773781 


0.977408 


0.998842 


0.999970 


1.000000 


0.1 





0.590490 


0.918540 


0.991440 


0.999540 


0.999990 


0.15 





0.443705 


0.835210 


0.973388 


0.997773 


0.999924 


0.2 





0.327680 


0.737280 


0.942080 


0.993280 


0.999680 


0.25 





0.237305 


0.632813 


0.896484 


0.984375 


0.999023 


0.3 





0.168070 


0.528220 


0.836920 


0.969220 


0.997570 


0.35 





0.116029 


0.428415 


0.764831 


0.945978 


0.994748 


0.4 





0.077760 


0.336960 


0.682560 


0.912960 


0.989760 


0.45 





0.050328 


0.256218 


0.593127 


0.868780 


0.981547 


0.5 





0.031250 


0.187500 


0.500000 


0.812500 


0.968750 








n - 


= 10 






j. Z. If> 11 11 11 \ A 


p 




T« 


T± 




^ 




0.05 





0.598737 


0.913862 


0.988496 


0.998971 


0.999936 




5 


0.999997 


1.000000 


1.000000 


1.000000 


1.000000 


0.1 





0.348678 


0.736099 


0.929809 


0.987205 


0.998365 




5 


0.999853 


0.999991 


1.000000 


1.000000 


1.000000 


0.15 





0.196874 


0.544300 


0.820197 


0.950030 


0.990126 




5 


0.998617 


0.999865 


0.999991 


1.000000 


1.000000 



{Continued} 
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TABLE A.1: 


Bernoulli CDF for n 


= 5 and n = 


10 (Continued) 












n = 


-- 10 






P 


k 




+ 1 






■3 


0.2 





0.107374 


0.375810 


0.677800 


0.879126 


0.967206 




5 


0.993631 


0.999136 


0.999922 


0.999996 


1.000000 


0.25 





0.056314 


0.244025 


0.525593 


0.775875 


0.921873 




5 


0.980272 


0.996494 


0.999584 


0.999970 


0.999999 


0.3 





0.028248 


0.149308 


0.382783 


0.649611 


0.849732 




5 


0.952651 


0.989408 


0.998410 


0.999856 


0.999994 


0.35 





0.013463 


0.085954 


0.261607 


0.513827 


0.751495 




5 


0.905066 


0.973976 


0.995179 


0.999460 


0.999972 


0.4 





0.006047 


0.046357 


0.167290 


0.382281 


0.633103 




5 


0.833761 


0.945238 


0.987705 


0.998322 


0.999895 


0.45 





0.002533 


0.023257 


0.099560 


0.266038 


0.504405 




5 


0.738437 


0.898005 


0.972608 


0.995498 


0.999659 


0.5 





0.000977 


0.010742 


0.054688 


0.171875 


0.376953 




5 


0.623047 


0.828125 


0.945313 


0.989258 


0.999023 



TABLE A.2: B< 


:rnoulli CDF for n 


= 15 












n = 


15 






p k 


+0 


+ 1 


+2 


+3 


+4 


0.05 


0.463291 


0.829047 


0.963800 


0.994533 


0.999385 


5 


0.999947 


0.999996 


1.000000 


1.000000 


1.000000 


10 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.1 


0.205891 


0.549043 


0.815939 


0.944444 


0.987280 


5 


0.997750 


0.999689 


0.999966 


0.999997 


1.000000 


10 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 
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TABLE A.2: B< 


:rnoulli CDF for n 


= 15 (Continued) 












n = 


15 






P 


k 


+0 


+ 1 


+2 


+3 


+4 


0.15 





0.087354 


0.318586 


0.604225 


0.822655 


0.938295 




5 


0.983190 


0.996394 


0.999390 


0.999919 


0.999992 




10 


0.999999 


1.000000 


1.000000 


1.000000 


1.000000 


0.2 





0.035184 


0.167126 


0.398023 


0.648162 


0.835766 




5 


0.938949 


0.981941 


0.995760 


0.999215 


0.999887 




10 


0.999988 


0.999999 


1.000000 


1.000000 


1.000000 


0.25 





0.013363 


0.080181 


0.236088 


0.461287 


0.686486 




5 


0.851632 


0.943380 


0.982700 


0.995807 


0.999205 




10 


0.999885 


0.999988 


0.999999 


1.000000 


1.000000 


0.3 





0.004748 


0.035268 


0.126828 


0.296868 


0.515491 




5 


0.721621 


0.868857 


0.949987 


0.984757 


0.996347 




10 


0.999328 


0.999908 


0.999991 


1.000000 


1.000000 


0.35 





0.001562 


0.014179 


0.061734 


0.172696 


0.351943 




5 


0.564282 


0.754842 


0.886769 


0.957806 


0.987557 




10 


0.997169 


0.999521 


0.999943 


0.999996 


1.000000 


0.4 





0.000470 


0.005172 


0.027114 


0.090502 


0.217278 




5 


0.403216 


0.609813 


0.786897 


0.904953 


0.966167 




10 


0.990652 


0.998072 


0.999721 


0.999975 


0.999999 


0.45 





0.000127 


0.001692 


0.010652 


0.042421 


0.120399 




5 


0.260760 


0.452160 


0.653504 


0.818240 


0.923071 




10 


0.974534 


0.993673 


0.998893 


0.999879 


0.999994 


0.5 





0.000031 


0.000488 


0.003693 


0.017578 


0.059235 




5 


0.150879 


0.303619 


0.500000 


0.696381 


0.849121 




10 


0.940765 


0.982422 


0.996307 


0.999512 


0.999969 
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TABLE A.3: Bernoulli CDF for n 


= 20 














n = 


20 






P 


k 


+0 


+ 1 


+2 


+3 


+4 


0.05 





0.358486 


0.735840 


0.924516 


0.984098 


0.997426 




5 


0.999671 


0.999966 


0.999997 


1.000000 


1.000000 




10 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 




15 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.1 





0.121577 


0.391747 


0.676927 


0.867047 


0.956825 




5 


0.988747 


0.997614 


0.999584 


0.999940 


0.999993 




10 


0.999999 


1.000000 


1.000000 


1.000000 


1.000000 




15 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.15 





0.038760 


0.175558 


0.404896 


0.647725 


0.829847 




5 


0.932692 


0.978065 


0.994079 


0.998671 


0.999752 




10 


0.999961 


0.999995 


0.999999 


1.000000 


1.000000 




15 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.2 





0.011529 


0.069175 


0.206085 


0.411449 


0.629648 




5 


0.804208 


0.913307 


0.967857 


0.990018 


0.997405 




10 


0.999437 


0.999898 


0.999985 


0.999998 


1.000000 




15 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.25 





0.003171 


0.024313 


0.091260 


0.225156 


0.414842 




5 


0.617173 


0.785782 


0.898188 


0.959075 


0.986136 




10 


0.996058 


0.999065 


0.999816 


0.999970 


0.999996 




15 


1.000000 


1.000000 


1.000000 


1.000000 


1.000000 


0.3 





0.000798 


0.007637 


0.035483 


0.107087 


0.237508 




5 


0.416371 


0.608010 


0.772272 


0.886669 


0.952038 




10 


0.982855 


0.994862 


0.998721 


0.999739 


0.999957 




15 


0.999994 


0.999999 


1.000000 


1.000000 


1.000000 


0.35 





0.000181 


0.002133 


0.012118 


0.044376 


0.118197 




5 


0.245396 


0.416625 


0.601027 


0.762378 


0.878219 




10 


0.946833 


0.980421 


0.993985 


0.998479 


0.999689 




15 


0.999950 


0.999994 


0.999999 


1.000000 


1.000000 
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TABLE A.3: B< 


:rnoulli CDF for n 


= 20 (Continued) 












n = 


20 






P 


k 


+0 


+ 1 






+4 


0.4 





0.000037 


0.000524 


0.003611 


0.015961 


0.050952 




5 


0.125599 


0.250011 


0.415893 


0.595599 


0.755337 




10 


0.872479 


0.943474 


0.978971 


0.993534 


0.998388 




15 


0.999683 


0.999953 


0.999995 


1.000000 


1.000000 


0.45 





0.000006 


0.000111 


0.000927 


0.004933 


0.018863 




5 


0.055334 


0.129934 


0.252006 


0.414306 


0.591361 




10 


0.750711 


0.869235 


0.941966 


0.978586 


0.993566 




15 


0.998469 


0.999723 


0.999964 


0.999997 


1.000000 


0.5 





0.000001 


0.000020 


0.000201 


0.001288 


0.005909 




5 


0.020695 


0.057659 


0.131588 


0.251722 


0.411901 




10 


0.588099 


0.748278 


0.868412 


0.942341 


0.979305 




15 


0.994091 


0.998712 


0.999799 


0.999980 


0.999999 



TABLE A.4: 


Poisson CDF for A. 


= 0.1,0.2,... 


,1,1.5,2, ...,4.5 






A 


k 


+0 


+1 


+2 


+3 


+4 


0.1 





0.904837 


0.995321 


0.999845 


0.999996 


1.000000 


0.2 





0.818731 


0.982477 


0.998852 


0.999943 


0.999998 


0.3 





0.740818 


0.963064 


0.996400 


0.999734 


0.999984 


0.4 





0.670320 


0.938448 


0.992074 


0.999224 


0.999939 


0.5 





0.606531 


0.909796 


0.985612 


0.998248 


0.999828 




5 


0.999986 


0.999999 


1.000000 


1.000000 


1.000000 


0.6 





0.548812 


0.878099 


0.976885 


0.996642 


0.999605 




5 


0.999961 


0.999997 


1.000000 


1.000000 


1.000000 


0.7 





0.496585 


0.844195 


0.965858 


0.994247 


0.999214 




5 


0.999910 


0.999991 


0.999999 


1.000000 


1.000000 
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TABLE A.4: 


Poisson CDF for X 


= 0.1,0.2,... 


,1,1.5,2,.. .,4 


5 (Continued) 
















WEM 


0.8 





0.449329 


0.808792 


0.952577 


0.990920 


0.998589 




5 


0.999816 


0.999979 


0.999998 


1.000000 


1.000000 


0.9 





0.406570 


0.772482 


0.937143 


0.986541 


0.997656 




5 


0.999656 


0.999957 


0.999995 


1.000000 


1.000000 


1 





0.367879 


0.735759 


0.919699 


0.981012 


0.996340 




5 


0.999406 


0.999917 


0.999990 


0.999999 


1.000000 


1.5 





0.223130 


0.557825 


0.808847 


0.934358 


0.981424 




5 


0.995544 


0.999074 


0.999830 


0.999972 


0.999996 


2 





0.135335 


0.406006 


0.676676 


0.857123 


0.947347 




5 


0.983436 


0.995466 


0.998903 


0.999763 


0.999954 


2.5 





0.082085 


0.287297 


0.543813 


0.757576 


0.891178 




5 


0.957979 


0.985813 


0.995753 


0.998860 


0.999723 




10 


0.999938 


0.999987 


0.999998 


1.000000 


1.000000 


3 





0.049787 


0.199148 


0.423190 


0.647232 


0.815263 




5 


0.916082 


0.966491 


0.988095 


0.996197 


0.998897 




10 


0.999708 


0.999929 


0.999984 


0.999997 


0.999999 


3.5 





0.030197 


0.135888 


0.320847 


0.536633 


0.725445 




5 


0.857614 


0.934712 


0.973261 


0.990126 


0.996685 




10 


0.998981 


0.999711 


0.999924 


0.999981 


0.999996 


4 





0.018316 


0.091578 


0.238103 


0.433470 


0.628837 




5 


0.785130 


0.889326 


0.948866 


0.978637 


0.991868 




10 


0.997160 


0.999085 


0.999726 


0.999924 


0.999980 


4.5 





0.011109 


0.061099 


0.173578 


0.342296 


0.532104 




5 


0.702930 


0.831051 


0.913414 


0.959743 


0.982907 




10 


0.993331 


0.997596 


0.999195 


0.999748 


0.999926 




15 


0.999980 


0.999995 


0.999999 


1.000000 


1.000000 
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TABLE A.5: 


Poisson CDF for A 


= 5,5.5, ...,8.5 




















KB 


5 





0.006738 


0.040428 


0.124652 


0.265026 


0.440493 




5 


0.615961 


0.762183 


0.866628 


0.931906 


0.968172 




10 


0.986305 


0.994547 


0.997981 


0.999302 


0.999774 




15 


0.999931 


0.999980 


0.999995 


0.999999 


1.000000 


5.5 





0.004087 


0.026564 


0.088376 


0.201699 


0.357518 




5 


0.528919 


0.686036 


0.809485 


0.894357 


0.946223 




10 


0.974749 


0.989012 


0.995549 


0.998315 


0.999401 




15 


0.999800 


0.999937 


0.999981 


0.999995 


0.999999 


6 





0.002479 


0.017351 


0.061969 


0.151204 


0.285057 




5 


0.445680 


0.606303 


0.743980 


0.847238 


0.916076 




10 


0.957379 


0.979908 


0.991173 


0.996372 


0.998600 




15 


0.999491 


0.999825 


0.999943 


0.999982 


0.999995 


6.5 





0.001503 


0.011276 


0.043036 


0.111850 


0.223672 




5 


0.369041 


0.526524 


0.672758 


0.791573 


0.877384 




10 


0.933161 


0.966120 


0.983973 


0.992900 


0.997044 




15 


0.998840 


0.999570 


0.999849 


0.999949 


0.999984 


7 





0.000912 


0.007295 


0.029636 


0.081765 


0.172992 




5 


0.300708 


0.449711 


0.598714 


0.729091 


0.830496 




10 


0.901479 


0.946650 


0.973000 


0.987189 


0.994283 




15 


0.997593 


0.999042 


0.999638 


0.999870 


0.999956 


7.5 





0.000553 


0.004701 


0.020257 


0.059145 


0.132062 




5 


0.241436 


0.378155 


0.524639 


0.661967 


0.776408 




10 


0.862238 


0.920759 


0.957334 


0.978435 


0.989740 




15 


0.995392 


0.998041 


0.999210 


0.999697 


0.999889 




20 


0.999961 


0.999987 


0.999996 


0.999999 


1.000000 
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PI: IML/FFX P2: IML 

MOBK042-Appe MOBK042-Enderle.cls October 30, 2006 19:54 



94 ADVANCED PROBABILITYTHEORY FOR BIOMEDICAL ENGINEERS 



TABLE A.5: 


Poisson CDF for X 


= 5,5.5,..., 


8.5 (Continued) 






D 






D 




msm 




8 





0.000335 


0.003019 


0.013754 


0.042380 


0.099632 




5 


0.191236 


0.313374 


0.452961 


0.592547 


0.716624 




10 


0.815886 


0.888076 


0.936203 


0.965819 


0.982743 




15 


0.991769 


0.996282 


0.998406 


0.999350 


0.999747 




20 


0.999906 


0.999967 


0.999989 


0.999996 


0.999999 


8.5 





0.000203 


0.001933 


0.009283 


0.030109 


0.074364 




5 


0.149597 


0.256178 


0.385597 


0.523105 


0.652974 




10 


0.763362 


0.848662 


0.909083 


0.948589 


0.972575 




15 


0.986167 


0.993387 


0.996998 


0.998703 


0.999465 




20 


0.999789 


0.999921 


0.999971 


0.999990 


0.999997 



TABLE A.6: 


Poisson CDF for X 


= 9,9.5,10,11 


12,13 








9 





0.000123 


0.001234 


0.006232 


0.021226 


0.054964 




5 


0.115691 


0.206781 


0.323897 


0.455653 


0.587408 




10 


0.705988 


0.803008 


0.875773 


0.926149 


0.958534 




15 


0.977964 


0.988894 


0.994680 


0.997574 


0.998944 




20 


0.999561 


0.999825 


0.999933 


0.999975 


0.999991 


9.5 





0.000075 


0.000786 


0.004164 


0.014860 


0.040263 




5 


0.088528 


0.164949 


0.268663 


0.391824 


0.521826 




10 


0.645328 


0.751990 


0.836430 


0.898136 


0.940008 




15 


0.966527 


0.982273 


0.991072 


0.995716 


0.998038 




20 


0.999141 


0.999639 


0.999855 


0.999944 


0.999979 


10 





0.000045 


0.000499 


0.002769 


0.010336 


0.029253 




5 


0.067086 


0.130141 


0.220221 


0.332820 


0.457930 




10 


0.583040 


0.696776 


0.791556 


0.864464 


0.916542 
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TABLE A.6: 


Poisson CDF for A, 


= 9,9.5,10,11 


12, 13 (Continued) 
















mm 




15 


0.951260 


0.972958 


0.985722 


0.992813 


0.996546 




20 


0.998412 


0.999300 


0.999704 


0.999880 


0.999953 


11 





0.000017 


0.000200 


0.001211 


0.004916 


0.015105 




5 


0.037520 


0.078614 


0.143192 


0.231985 


0.340511 




10 


0.459889 


0.579267 


0.688697 


0.781291 


0.854044 




15 


0.907396 


0.944076 


0.967809 


0.982313 


0.990711 




20 


0.995329 


0.997748 


0.998958 


0.999536 


0.999801 




25 


0.999918 


0.999967 


0.999987 


0.999995 


0.999998 


12 





0.000006 


0.000080 


0.000522 


0.002292 


0.007600 




5 


0.020341 


0.045822 


0.089505 


0.155028 


0.242392 




10 


0.347229 


0.461597 


0.575965 


0.681536 


0.772025 




15 


0.844416 


0.898709 


0.937034 


0.962584 


0.978720 




20 


0.988402 


0.993935 


0.996953 


0.998527 


0.999314 




25 


0.999692 


0.999867 


0.999944 


0.999977 


0.999991 


13 





0.000002 


0.000032 


0.000223 


0.001050 


0.003740 




5 


0.010734 


0.025887 


0.054028 


0.099758 


0.165812 




10 


0.251682 


0.353165 


0.463105 


0.573045 


0.675132 




15 


0.763607 


0.835493 


0.890465 


0.930167 


0.957331 




20 


0.974988 


0.985919 


0.992378 


0.996028 


0.998006 




25 


0.999034 


0.999548 


0.999796 


0.999911 


0.999962 



TABLE A.7: 


Poisson CDF for A 


= 14,15,16,17,18 


















14 




0.000001 


0.000012 0.000094 


0.000474 


0.001805 


5 




0.005532 


0.014228 0.031620 


0.062055 


0.109399 


10 




0.175681 


0.260040 0.358458 


0.464448 


0.570437 
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TABLE A.7: 


Poisson CDF for X. 


= 14,15,16,17, 


18 (Continued) 






D 






IB 










15 


0.669360 


0.755918 


0.827201 


0.882643 


0.923495 




20 


0.952092 


0.971156 


0.983288 


0.990672 


0.994980 




25 


0.997392 


0.998691 


0.999365 


0.999702 


0.999864 




30 


0.999940 


0.999974 


0.999989 


0.999996 


0.999998 


15 





0.000000 


0.000005 


0.000039 


0.000211 


0.000857 




5 


0.002792 


0.007632 


0.018002 


0.037446 


0.069854 




10 


0.118464 


0.184752 


0.267611 


0.363218 


0.465654 




15 


0.568090 


0.664123 


0.748859 


0.819472 


0.875219 




20 


0.917029 


0.946894 


0.967256 


0.980535 


0.988835 




25 


0.993815 


0.996688 


0.998284 


0.999139 


0.999582 




30 


0.999803 


0.999910 


0.999960 


0.999983 


0.999993 


16 





0.000000 


0.000002 


0.000016 


0.000093 


0.000400 




5 


0.001384 


0.004006 


0.010000 


0.021987 


0.043298 




10 


0.077396 


0.126993 


0.193122 


0.274511 


0.367527 




15 


0.466745 


0.565962 


0.659344 


0.742349 


0.812249 




20 


0.868168 


0.910773 


0.941759 


0.963314 


0.977685 




25 


0.986881 


0.992541 


0.995895 


0.997811 


0.998869 




30 


0.999433 


0.999724 


0.999869 


0.999940 


0.999973 


17 





0.000000 


0.000001 


0.000007 


0.000041 


0.000185 




5 


0.000675 


0.002062 


0.005433 


0.012596 


0.026125 




10 


0.049124 


0.084669 


0.135024 


0.200873 


0.280833 




15 


0.371454 


0.467738 


0.564023 


0.654958 


0.736322 




20 


0.805481 


0.861466 


0.904728 


0.936704 


0.959354 




25 


0.974755 


0.984826 


0.991166 


0.995016 


0.997273 




30 


0.998552 


0.999253 


0.999626 


0.999817 


0.999913 
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TABLE A.7: 


Poisson CDF for A. 


= 14,15,16,17, 


18 (Continued) 
















msm 


18 


0.000000 


0.000000 


0.000003 


0.000018 


0.000084 


5 


0.000324 


0.001043 


0.002893 


0.007056 


0.015381 


10 


0.030366 


0.054887 


0.091669 


0.142598 


0.208077 


15 


0.286653 


0.375050 


0.468648 


0.562245 


0.650916 


20 


0.730720 


0.799124 


0.855090 


0.898890 


0.931740 


25 


0.955392 


0.971766 


0.982682 


0.989700 


0.994056 


30 


0.996669 


0.998187 


0.999040 


0.999506 


0.999752 



TABLE A.8: Marcum's 


Q_function for a — 


0,0.01,..., 1.99 






a 


+0.00 


+0.01 


+0.02 


+0.03 


+0.04 


0.00 


0.500000 


0.496011 


0.492022 


0.488033 


0.484046 


0.05 


0.480061 


0.476078 


0.472097 


0.468119 


0.464144 


0.10 


0.460172 


0.456205 


0.452242 


0.448283 


0.444330 


0.15 


0.440382 


0.436441 


0.432505 


0.428576 


0.424655 


0.20 


0.420740 


0.416834 


0.412936 


0.409046 


0.405165 


0.25 


0.401294 


0.397432 


0.393580 


0.389739 


0.385908 


0.30 


0.382089 


0.378281 


0.374484 


0.370700 


0.366928 


0.35 


0.363169 


0.359424 


0.355691 


0.351973 


0.348268 


0.40 


0.344578 


0.340903 


0.337243 


0.333598 


0.329969 


0.45 


0.326355 


0.322758 


0.319178 


0.315614 


0.312067 


0.50 


0.308538 


0.305026 


0.301532 


0.298056 


0.294598 


0.55 


0.291160 


0.287740 


0.284339 


0.280957 


0.277595 


0.60 


0.274253 


0.270931 


0.267629 


0.264347 


0.261086 


0.65 


0.257846 


0.254627 


0.251429 


0.248252 


0.245097 
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TABLE A.8: Marcum's QJunction for a = 


0,0.01,..., 1.99 (Continued) 




a 


+0.00 


+0.01 


+0.02 


+0.03 


+0.04 


0.70 


0.241964 


0.238852 


0.235762 


0.232695 


0.229650 


0.75 


0.226627 


0.223627 


0.220650 


0.217695 


0.214764 


0.80 


0.211855 


0.208970 


0.206108 


0.203269 


0.200454 


0.85 


0.197662 


0.194894 


0.192150 


0.189430 


0.186733 


0.90 


0.184060 


0.181411 


0.178786 


0.176186 


0.173609 


0.95 


0.171056 


0.168528 


0.166023 


0.163543 


0.161087 


1.00 


0.158655 


0.156248 


0.153864 


0.151505 


0.149170 


1.05 


0.146859 


0.144572 


0.142310 


0.140071 


0.137857 


1.10 


0.135666 


0.133500 


0.131357 


0.129238 


0.127143 


1.15 


0.125072 


0.123024 


0.121001 


0.119000 


0.117023 


1.20 


0.115070 


0.113140 


0.111233 


0.109349 


0.107488 


1.25 


0.105650 


0.103835 


0.102042 


0.100273 


0.098525 


1.30 


0.096801 


0.095098 


0.093418 


0.091759 


0.090123 


1.35 


0.088508 


0.086915 


0.085344 


0.083793 


0.082264 


1.40 


0.080757 


0.079270 


0.077804 


0.076359 


0.074934 


1.45 


0.073529 


0.072145 


0.070781 


0.069437 


0.068112 


1.50 


0.066807 


0.065522 


0.064256 


0.063008 


0.061780 


1.55 


0.060571 


0.059380 


0.058208 


0.057053 


0.055917 


1.60 


0.054799 


0.053699 


0.052616 


0.051551 


0.050503 


1.65 


0.049471 


0.048457 


0.047460 


0.046479 


0.045514 


1.70 


0.044565 


0.043633 


0.042716 


0.041815 


0.040929 


1.75 


0.040059 


0.039204 


0.038364 


0.037538 


0.036727 


1.80 


0.035930 


0.035148 


0.034379 


0.033625 


0.032884 


1.85 


0.032157 


0.031443 


0.030742 


0.030054 


0.029379 


1.90 


0.028716 


0.028067 


0.027429 


0.026803 


0.026190 


1.95 


0.025588 


0.024998 


0.024419 


0.023852 


0.023295 
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TABLE A.9: Marcum's Q_function for a — 


3, 3.01,..., 3.99 






a 


+0.00 


+0.01 


+0.02 


+0.03 


+0.04 


2.00 


0.022750 


0.022216 


0.021692 


0.021178 


0.020675 


2.05 


0.020182 


0.019699 


0.019226 


0.018763 


0.018309 


2.10 


0.017864 


0.017429 


0.017003 


0.016586 


0.016177 


2.15 


0.015778 


0.015386 


0.015003 


0.014629 


0.014262 


2.20 


0.013903 


0.013553 


0.013209 


0.012874 


0.012545 


2.25 


0.012224 


0.011911 


0.011604 


0.011304 


0.011011 


2.30 


0.010724 


0.010444 


0.010170 


0.009903 


0.009642 


2.35 


0.009387 


0.009137 


0.008894 


0.008656 


0.008424 


2.40 


0.008198 


0.007976 


0.007760 


0.007549 


0.007344 


2.45 


0.007143 


0.006947 


0.006756 


0.006569 


0.006387 


2.50 


0.006210 


0.006037 


0.005868 


0.005703 


0.005543 


2.55 


0.005386 


0.005234 


0.005085 


0.004940 


0.004799 


2.60 


0.004661 


0.004527 


0.004397 


0.004269 


0.004145 


2.65 


0.004025 


0.003907 


0.003793 


0.003681 


0.003573 


2.70 


0.003467 


0.003364 


0.003264 


0.003167 


0.003072 


2.75 


0.002980 


0.002890 


0.002803 


0.002718 


0.002635 


2.80 


0.002555 


0.002477 


0.002401 


0.002327 


0.002256 


2.85 


0.002186 


0.002118 


0.002052 


0.001988 


0.001926 


2.90 


0.001866 


0.001807 


0.001750 


0.001695 


0.001641 


2.95 


0.001589 


0.001538 


0.001489 


0.001441 


0.001395 


3.00 


0.001350 


0.001306 


0.001264 


0.001223 


0.001183 


3.05 


0.001144 


0.001107 


0.001070 


0.001035 


0.001001 


3.10 


0.000968 


0.000936 


0.000904 


0.000874 


0.000845 


3.15 


0.000816 


0.000789 


0.000762 


0.000736 


0.000711 


3.20 


0.000687 


0.000664 


0.000641 


0.000619 


0.000598 


3.25 


0.000577 


0.000557 


0.000538 


0.000519 


0.000501 


3.30 


0.000483 


0.000467 


0.000450 


0.000434 


0.000419 
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TABLE A.9: Marcum's 


Q_function for a — 


3, 3.01,..., 3. 99 (Continued) 




a 


+0.00 


+0.01 


+0.02 


+0.03 


+0.04 


3.35 


0.000404 


0.000390 


0.000376 


0.000362 


0.000350 


3.40 


0.000337 


0.000325 


0.000313 


0.000302 


0.000291 


3.45 


0.000280 


0.000270 


0.000260 


0.000251 


0.000242 


3.50 


0.000233 


0.000224 


0.000216 


0.000208 


0.000200 


3.55 


0.000193 


0.000185 


0.000179 


0.000172 


0.000165 


3.60 


0.000159 


0.000153 


0.000147 


0.000142 


0.000136 


3.65 


0.000131 


0.000126 


0.000121 


0.000117 


0.000112 


3.70 


0.000108 


0.000104 


0.000100 


0.000096 


0.000092 


3.75 


0.000088 


0.000085 


0.000082 


0.000078 


0.000075 


3.80 


0.000072 


0.000070 


0.000067 


0.000064 


0.000062 


3.85 


0.000059 


0.000057 


0.000054 


0.000052 


0.000050 


3.90 


0.000048 


0.000046 


0.000044 


0.000042 


0.000041 


3.95 


0.000039 


0.000037 


0.000036 


0.000034 


0.000033 



